Jul 21 06:17:41.291388 ip-10-0-136-215 systemd[1]: Starting Kubernetes Kubelet... Jul 21 06:17:41.732601 ip-10-0-136-215 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 06:17:41.732601 ip-10-0-136-215 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 06:17:41.732601 ip-10-0-136-215 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 06:17:41.732601 ip-10-0-136-215 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 06:17:41.732601 ip-10-0-136-215 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 06:17:41.734524 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.734436 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 06:17:41.742225 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742205 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.742225 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742223 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.742225 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742227 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742232 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742235 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742238 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742241 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742244 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742247 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742249 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742252 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742255 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742258 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742260 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742263 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742265 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742268 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742270 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742273 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742275 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742278 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.742315 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742281 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742284 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742287 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742289 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742292 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742294 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742297 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742300 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742303 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742305 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742308 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742310 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742313 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742316 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742318 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742322 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742325 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742327 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742337 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742340 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.742756 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742342 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742345 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742347 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742350 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742352 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742354 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742357 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742359 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742361 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742364 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742366 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742370 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742374 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742377 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742381 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742384 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742386 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742389 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742391 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742394 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.743284 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742396 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742399 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742401 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742404 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742406 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742409 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742411 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742414 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742416 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742419 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742421 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742424 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742426 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742429 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742431 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742434 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742437 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742442 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742444 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742447 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.743783 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742449 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742452 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742454 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742457 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742459 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742462 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742466 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742469 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742471 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742474 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742476 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742479 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742481 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742483 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742487 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742490 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742493 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.742496 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743231 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.744267 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743239 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743243 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743247 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743249 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743253 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743256 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743259 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743262 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743264 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743267 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743269 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743272 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743274 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743277 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743279 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743282 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743285 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743288 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743291 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743294 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.744769 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743297 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743300 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743303 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743305 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743308 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743310 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743313 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743315 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743318 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743320 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743323 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743326 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743329 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743332 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743335 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743337 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743340 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743343 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743345 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743347 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.745293 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743350 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743352 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743355 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743357 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743360 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743362 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743365 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743367 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743370 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743372 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743375 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743378 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743381 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743383 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743386 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743389 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743391 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743394 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743396 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743399 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.745809 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743403 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743406 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743410 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743412 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743415 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743418 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743420 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743423 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743426 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743428 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743432 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743435 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743439 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743442 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743445 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743448 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743450 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743453 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743456 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.746311 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743458 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743461 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743464 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743466 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743470 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743472 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743475 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743477 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743480 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743483 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743485 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743488 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743490 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743493 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743495 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743498 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743519 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743522 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743526 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.746768 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743908 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743913 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743917 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743920 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743923 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743926 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743929 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743932 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743935 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743938 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743941 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743944 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743946 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743949 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743952 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743954 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743956 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743962 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743965 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743967 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.747232 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743969 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743972 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743975 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743977 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743980 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743982 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743984 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743987 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743989 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743992 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743994 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743996 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.743999 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744001 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744004 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744006 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744009 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744018 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744020 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744023 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.747712 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744025 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744028 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744031 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744033 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744036 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744038 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744041 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744043 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744045 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744049 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744052 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744054 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744057 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744059 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744062 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744065 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744067 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744070 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744072 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744074 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.748212 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744077 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744079 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744081 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744084 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744087 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744089 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744092 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744094 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744097 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744099 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744103 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744106 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744127 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744132 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744135 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744155 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744159 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744162 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744165 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.748744 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744168 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744170 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744174 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744177 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744180 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744183 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744186 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744188 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744191 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744193 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744196 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744199 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744203 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744206 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744208 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744212 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744215 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744219 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744222 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.749338 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744225 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744293 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744300 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744306 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744310 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744315 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744319 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744322 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744327 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744330 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744333 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744336 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744339 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744342 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744345 2572 flags.go:64] FLAG: --cgroup-root="" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744348 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744351 2572 flags.go:64] FLAG: --client-ca-file="" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744354 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744357 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744361 2572 flags.go:64] FLAG: --cluster-domain="" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744364 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744367 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744370 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744373 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 06:17:41.749808 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744376 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744379 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744382 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744385 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744388 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744391 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744395 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744398 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744401 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744409 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744412 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744415 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744418 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744420 2572 flags.go:64] FLAG: --enable-server="true" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744424 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744428 2572 flags.go:64] FLAG: --event-burst="100" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744431 2572 flags.go:64] FLAG: --event-qps="50" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744434 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744437 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744440 2572 flags.go:64] FLAG: --eviction-hard="" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744443 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744446 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744449 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744452 2572 flags.go:64] FLAG: --eviction-soft="" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744455 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 06:17:41.750379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744458 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744460 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744463 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744466 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744469 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744472 2572 flags.go:64] FLAG: --feature-gates="" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744475 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744478 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744481 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744484 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744487 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744490 2572 flags.go:64] FLAG: --help="false" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744493 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-215.ec2.internal" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744497 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744500 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744503 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744506 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744510 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744512 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744515 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744518 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744521 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744525 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744528 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 06:17:41.751017 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744530 2572 flags.go:64] FLAG: --kube-reserved="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744533 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744536 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744538 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744541 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744544 2572 flags.go:64] FLAG: --lock-file="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744547 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744550 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744553 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744558 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744561 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744564 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744567 2572 flags.go:64] FLAG: --logging-format="text" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744570 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744573 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744576 2572 flags.go:64] FLAG: --manifest-url="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744579 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744583 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744586 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744590 2572 flags.go:64] FLAG: --max-pods="110" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744593 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744597 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744600 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744603 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744605 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 06:17:41.751620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744609 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744611 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744619 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744622 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744625 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744628 2572 flags.go:64] FLAG: --pod-cidr="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744631 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744636 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744639 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744642 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744645 2572 flags.go:64] FLAG: --port="10250" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744648 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744651 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c5fc5f89a9458bd0" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744654 2572 flags.go:64] FLAG: --qos-reserved="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744657 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744660 2572 flags.go:64] FLAG: --register-node="true" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744662 2572 flags.go:64] FLAG: --register-with-taints="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744666 2572 flags.go:64] FLAG: --registry-burst="10" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744668 2572 flags.go:64] FLAG: --registry-qps="5" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744671 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744674 2572 flags.go:64] FLAG: --reserved-memory="" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744677 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744680 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744683 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744686 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 06:17:41.752301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744688 2572 flags.go:64] FLAG: --runonce="false" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744691 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744694 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744699 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744702 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744704 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744707 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744710 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744714 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744716 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744719 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744722 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744724 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744727 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744730 2572 flags.go:64] FLAG: --system-cgroups="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744734 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744739 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744742 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744744 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744749 2572 flags.go:64] FLAG: --tls-min-version="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744752 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744756 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744759 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744761 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744764 2572 flags.go:64] FLAG: --v="2" Jul 21 06:17:41.752895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744768 2572 flags.go:64] FLAG: --version="false" Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744772 2572 flags.go:64] FLAG: --vmodule="" Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744776 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.744779 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744893 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744906 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744910 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744913 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744915 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744918 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744921 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744923 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744926 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744929 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744932 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744934 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744937 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744939 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744942 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744944 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744947 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.753520 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744949 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744959 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744961 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744964 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744966 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744969 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744972 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744975 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744978 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744980 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744983 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744985 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744988 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744990 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744993 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744995 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.744998 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745000 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745003 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745005 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.754028 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745008 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745011 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745020 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745022 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745025 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745027 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745030 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745032 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745034 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745037 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745039 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745042 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745044 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745046 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745050 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745052 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745055 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745057 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745060 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745064 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.754559 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745066 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745069 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745071 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745074 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745076 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745078 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745081 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745083 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745086 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745088 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745091 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745095 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745098 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745101 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745104 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745107 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745123 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745127 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745129 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.755044 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745132 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745135 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745138 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745141 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745143 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745146 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745150 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745154 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745159 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745162 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745165 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745168 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745171 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745174 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745177 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745179 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745182 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745184 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.755521 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745186 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745189 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745192 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745194 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.745197 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.745960 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.753872 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.753889 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.753905 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.753912 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753976 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753980 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753984 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753987 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753990 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.755948 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753993 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753996 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.753998 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754001 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754005 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754009 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754012 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754015 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754018 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754021 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754024 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754026 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754029 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754031 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754034 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754037 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754039 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754046 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754048 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754051 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.756330 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754054 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754056 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754059 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754061 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754065 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754069 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754072 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754074 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754077 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754079 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754082 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754085 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754087 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754090 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754093 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754095 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754098 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754100 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754102 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.756808 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754105 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754126 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754129 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754131 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754134 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754136 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754139 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754141 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754144 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754146 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754149 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754151 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754154 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754157 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754159 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754162 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754164 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754167 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754171 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754173 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.757299 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754176 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754178 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754181 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754183 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754186 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754189 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754193 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754195 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754198 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754200 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754203 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754205 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754208 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754210 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754219 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754222 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754224 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754227 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754229 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.757792 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754232 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754234 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754238 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754240 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754242 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754245 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754247 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754250 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754252 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754255 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754258 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754261 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754263 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754266 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754268 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.758303 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754270 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.754275 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754438 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754445 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754448 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754451 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754453 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754456 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754458 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754460 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754463 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754465 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754467 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754476 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754478 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 06:17:41.758659 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754481 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754483 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754485 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754488 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754490 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754493 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754495 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754497 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754500 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754502 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754504 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754507 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754510 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754512 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754515 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754517 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754519 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754522 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754524 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 06:17:41.759016 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754526 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754534 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754537 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754539 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754541 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754543 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754546 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754548 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754551 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754553 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754555 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754558 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754566 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754569 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754571 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754573 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754576 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754579 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754581 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754584 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 06:17:41.759540 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754586 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754589 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754592 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754594 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754596 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754599 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754601 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754604 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754606 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754608 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754611 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754613 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754615 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754618 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754620 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754622 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754624 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754627 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754629 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 06:17:41.760009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754633 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754636 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754639 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754642 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754644 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754647 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754655 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754658 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754661 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754665 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754668 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754671 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754673 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754676 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754679 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754681 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754684 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754686 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754689 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754691 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 06:17:41.760470 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754694 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754696 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754698 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754700 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754703 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754705 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754708 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:41.754710 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.754714 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.754833 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.757389 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.759137 2572 server.go:1019] "Starting client certificate rotation" Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.759254 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 06:17:41.760946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.759288 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 06:17:41.762921 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.762905 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 06:17:41.770711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.770687 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 06:17:41.785423 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.785399 2572 log.go:25] "Validated CRI v1 runtime API" Jul 21 06:17:41.787911 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.787895 2572 log.go:25] "Validated CRI v1 image API" Jul 21 06:17:41.788803 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.788779 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 06:17:41.790214 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.790198 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 06:17:41.793589 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.793566 2572 fs.go:135] Filesystem UUIDs: map[374c053d-fc00-4065-8ca8-1917704ec118:/dev/nvme0n1p3 6256b62b-8203-4c1c-87d0-b3a408beb98c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 21 06:17:41.793664 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.793588 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 06:17:41.797919 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.797799 2572 manager.go:216] Machine: {Timestamp:2026-07-21 06:17:41.797308393 +0000 UTC m=+0.378089578 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3083476 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2867c70a585e5c8c20a62c2545614c SystemUUID:ec2867c7-0a58-5e5c-8c20-a62c2545614c BootID:da139b4f-96e4-4dfe-86aa-8df8a0ab8488 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d7:9c:39:0c:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d7:9c:39:0c:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:68:88:26:69:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 06:17:41.797919 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.797906 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 06:17:41.798077 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.798059 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 06:17:41.801894 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.801871 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 06:17:41.802028 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.801898 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 06:17:41.802700 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.802690 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 06:17:41.802738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.802703 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 06:17:41.802738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.802710 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 06:17:41.802738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.802723 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 06:17:41.804649 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.804639 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 06:17:41.809303 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809291 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 21 06:17:41.809425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809415 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 06:17:41.809462 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809447 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 21 06:17:41.809462 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809460 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 06:17:41.809518 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809481 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 06:17:41.809518 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809495 2572 kubelet.go:398] "Adding apiserver pod source" Jul 21 06:17:41.809518 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.809505 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 06:17:41.810037 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.810018 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 06:17:41.810142 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.810041 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 06:17:41.812489 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.812464 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 06:17:41.814475 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.814459 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 06:17:41.814541 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.814491 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 06:17:41.815478 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815465 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 06:17:41.815515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815482 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 06:17:41.815515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815489 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 06:17:41.815515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815495 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 06:17:41.815515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815503 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 06:17:41.815515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815509 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815521 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815527 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815534 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815539 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815549 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 06:17:41.815646 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.815554 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 06:17:41.817161 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.817149 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 06:17:41.817161 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.817162 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 06:17:41.822576 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.822542 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 06:17:41.822683 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.822573 2572 server.go:1268] "Started kubelet" Jul 21 06:17:41.822975 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.822953 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 06:17:41.823287 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.823257 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 06:17:41.823878 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.823817 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 06:17:41.823972 ip-10-0-136-215 systemd[1]: Started Kubernetes Kubelet. Jul 21 06:17:41.824853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.824073 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 06:17:41.825544 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.825517 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 06:17:41.826532 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.826512 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 21 06:17:41.827810 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.827790 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 06:17:41.831672 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.831646 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s7b7v" Jul 21 06:17:41.831993 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.831965 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 06:17:41.833983 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.832837 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-215.ec2.internal.18c4399462df8a74 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-215.ec2.internal,UID:ip-10-0-136-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-215.ec2.internal,},FirstTimestamp:2026-07-21 06:17:41.82231922 +0000 UTC m=+0.403100407,LastTimestamp:2026-07-21 06:17:41.82231922 +0000 UTC m=+0.403100407,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-215.ec2.internal,}" Jul 21 06:17:41.835334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.835319 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s7b7v" Jul 21 06:17:41.842044 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.842019 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 06:17:41.842044 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.842021 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 06:17:41.842302 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.842149 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:41.842898 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.842878 2572 factory.go:55] Registering systemd factory Jul 21 06:17:41.842977 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.842900 2572 factory.go:223] Registration of the systemd container factory successfully Jul 21 06:17:41.843229 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843153 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 06:17:41.843229 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843159 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 06:17:41.843229 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843181 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 06:17:41.843367 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843298 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 21 06:17:41.843367 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843305 2572 factory.go:153] Registering CRI-O factory Jul 21 06:17:41.843367 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843321 2572 factory.go:223] Registration of the crio container factory successfully Jul 21 06:17:41.843367 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843306 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 21 06:17:41.843490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843373 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 06:17:41.843490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843394 2572 factory.go:103] Registering Raw factory Jul 21 06:17:41.843490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843407 2572 manager.go:1196] Started watching for new ooms in manager Jul 21 06:17:41.843878 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.843863 2572 manager.go:349] Starting recovery of all containers Jul 21 06:17:41.844478 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.844449 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 06:17:41.844567 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.844545 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 06:17:41.853779 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.853765 2572 manager.go:354] Recovery completed Jul 21 06:17:41.857710 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.857698 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:41.859361 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859345 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:41.859436 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859378 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:41.859436 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859392 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:41.859966 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859952 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 06:17:41.860016 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859964 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:41.860051 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.859965 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 06:17:41.860084 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.860068 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 21 06:17:41.860740 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.860722 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:41.860825 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.860752 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:41.860825 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.860766 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:41.862650 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.862637 2572 policy_none.go:49] "None policy: Start" Jul 21 06:17:41.862706 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.862653 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 06:17:41.862706 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.862664 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 06:17:41.864559 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.864549 2572 policy_none.go:47] "Start" Jul 21 06:17:41.895749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.895728 2572 manager.go:337] "Starting Device Plugin manager" Jul 21 06:17:41.895873 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.895769 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 06:17:41.895873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.895782 2572 server.go:87] "Starting device plugin registration server" Jul 21 06:17:41.896202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.896056 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 06:17:41.896281 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.896211 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 06:17:41.896334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.896315 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 06:17:41.896415 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.896399 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 06:17:41.896415 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.896415 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 06:17:41.897045 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.897020 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 06:17:41.897129 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.897083 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:41.950679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.949515 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 06:17:41.955497 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.955482 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 06:17:41.955580 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.955516 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 06:17:41.955580 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.955535 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 06:17:41.955580 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:41.955564 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 06:17:41.957956 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.957938 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:41.996916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.996842 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:41.998683 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.998666 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:41.998743 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.998702 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:41.998743 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.998714 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:41.998743 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:41.998736 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.010198 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.010172 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.010307 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.010202 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-215.ec2.internal\": node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.047172 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.047143 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.056320 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.056294 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal"] Jul 21 06:17:42.056381 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.056360 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:42.057325 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.057311 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:42.057374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.057341 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:42.057374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.057351 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:42.059595 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.059583 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:42.059716 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.059700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.059761 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.059736 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:42.060310 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060292 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:42.060374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060323 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:42.060374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060293 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:42.060374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060336 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:42.060374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060352 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:42.060374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.060367 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:42.062689 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.062675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.062735 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.062702 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 06:17:42.063397 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.063385 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientMemory" Jul 21 06:17:42.063456 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.063410 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 06:17:42.063456 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.063420 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeHasSufficientPID" Jul 21 06:17:42.086721 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.086703 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-215.ec2.internal\" not found" node="ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.091054 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.091039 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-215.ec2.internal\" not found" node="ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.145258 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.145238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.145258 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.145265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.145365 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.145282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7c5f08313d5b925e981af86d9cc424a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-215.ec2.internal\" (UID: \"f7c5f08313d5b925e981af86d9cc424a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.147338 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.147322 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.245901 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.245846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.245901 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.245910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7c5f08313d5b925e981af86d9cc424a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-215.ec2.internal\" (UID: \"f7c5f08313d5b925e981af86d9cc424a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.246093 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.245957 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f7c5f08313d5b925e981af86d9cc424a-config\") pod \"kube-apiserver-proxy-ip-10-0-136-215.ec2.internal\" (UID: \"f7c5f08313d5b925e981af86d9cc424a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.246093 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.245963 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.246093 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.246005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.246093 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.246032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9cfe80bb4d2d5959e89e104d7b84b44-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal\" (UID: \"d9cfe80bb4d2d5959e89e104d7b84b44\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.247977 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.247937 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.348830 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.348791 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.389005 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.388977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.394983 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.394964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.449912 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.449882 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.550483 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.550426 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.650992 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.650967 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-215.ec2.internal\" not found" Jul 21 06:17:42.702897 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.702872 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:42.742968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.742931 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.750885 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.750862 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 06:17:42.752248 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.752231 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.758169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.758152 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 06:17:42.758291 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.758274 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 06:17:42.758346 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.758312 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 06:17:42.758380 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.758325 2572 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://af55510b724494f2e8118d679c3017f3-e30376f527ca993e.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.136.215:37950->52.5.178.137:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" Jul 21 06:17:42.784703 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.784677 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:42.809992 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.809935 2572 apiserver.go:52] "Watching apiserver" Jul 21 06:17:42.819481 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.819455 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 06:17:42.819870 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.819844 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vvzgb","openshift-cluster-node-tuning-operator/tuned-wsxqq","openshift-multus/multus-2td7f","openshift-multus/multus-additional-cni-plugins-l5h5p","openshift-multus/network-metrics-daemon-vmpc6","openshift-network-diagnostics/network-check-target-cfb2j","openshift-network-operator/iptables-alerter-k97df","openshift-ovn-kubernetes/ovnkube-node-jd96j","kube-system/konnectivity-agent-5gnxm","kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm","openshift-dns/node-resolver-lcvbx","openshift-image-registry/node-ca-pv2mz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal"] Jul 21 06:17:42.822947 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.822925 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.825336 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.825318 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.825785 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.825762 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 06:17:42.825875 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.825766 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4b9c6\"" Jul 21 06:17:42.825875 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.825811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.825875 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.825811 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.828071 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.828053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.828179 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.828098 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 06:17:42.828240 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.828204 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.828326 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.828307 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.828515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.828499 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z24dr\"" Jul 21 06:17:42.830673 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.830658 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.830757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.830707 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.830807 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.830774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.830847 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.830807 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 06:17:42.830891 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.830776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 06:17:42.831129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.831104 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2w5z\"" Jul 21 06:17:42.833398 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.833382 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 06:17:42.833398 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.833395 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 06:17:42.833555 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.833406 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m87r8\"" Jul 21 06:17:42.833555 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.833484 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.833555 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.833534 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:42.836228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.836213 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:42.836283 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.836262 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:42.838742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.838718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.841381 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.841366 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 06:17:42.841483 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.841433 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 06:17:42.841567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.841549 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.841619 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.841572 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9jq8w\"" Jul 21 06:17:42.842181 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.842166 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 06:17:42.843824 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.843790 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 06:12:42 +0000 UTC" deadline="2027-12-26 18:03:35.393863951 +0000 UTC" Jul 21 06:17:42.843824 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.843823 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12563h45m52.550043368s" Jul 21 06:17:42.844217 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.844193 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.844334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.844235 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.844334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.844245 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.844440 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.844401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-khhfb\"" Jul 21 06:17:42.846728 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.846710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.846867 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.846853 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p457f\"" Jul 21 06:17:42.846977 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.846852 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.847339 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.847316 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.849120 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:42.849205 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.849205 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtgq\" (UniqueName: \"kubernetes.io/projected/984533da-66c0-4ed2-b59c-7258adfb3890-kube-api-access-kdtgq\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.849265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-run\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.849265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3d17367-f5b8-49d2-9468-84cb73ea78db-hosts-file\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.849265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-netns\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-hostroot\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-multus-certs\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849394 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6149349e-ba6d-4171-bb14-992eb1916b1e-agent-certs\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56t6k\" (UniqueName: \"kubernetes.io/projected/bd536a99-1717-4e99-b2df-4127807bcb27-kube-api-access-56t6k\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-socket-dir-parent\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6149349e-ba6d-4171-bb14-992eb1916b1e-konnectivity-ca\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ba51b6-3821-4fd6-9624-be00cd8859e2-host-slash\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-tmp\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-system-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-sys\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-etc-tuned\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-daemon-config\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849662 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849677 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd536a99-1717-4e99-b2df-4127807bcb27-serviceca\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849689 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.849714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cni-binary-copy\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-bin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849756 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-conf-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-os-release\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63ba51b6-3821-4fd6-9624-be00cd8859e2-iptables-alerter-script\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5xw\" (UniqueName: \"kubernetes.io/projected/63ba51b6-3821-4fd6-9624-be00cd8859e2-kube-api-access-7x5xw\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysconfig\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849887 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-os-release\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-multus\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cnibin\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.849994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d17367-f5b8-49d2-9468-84cb73ea78db-tmp-dir\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v866d\" (UniqueName: \"kubernetes.io/projected/e3d17367-f5b8-49d2-9468-84cb73ea78db-kube-api-access-v866d\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-kubernetes\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-systemd\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-lib-modules\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850144 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:42.850261 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-kubelet\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850220 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-etc-kubernetes\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvq6g\" (UniqueName: \"kubernetes.io/projected/d6d0eb93-3794-4ae0-8ae2-db985ce71001-kube-api-access-lvq6g\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850304 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd536a99-1717-4e99-b2df-4127807bcb27-host\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cnibin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850616 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-modprobe-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-conf\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-var-lib-kubelet\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-host\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-k8s-cni-cncf-io\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74pm\" (UniqueName: \"kubernetes.io/projected/a7af2564-40d3-41c4-a85f-046991fd670a-kube-api-access-d74pm\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.850871 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:42.850961 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.850841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t89mm\" (UniqueName: \"kubernetes.io/projected/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-kube-api-access-t89mm\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.853937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.852000 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.853937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.852366 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2zdfx\"" Jul 21 06:17:42.853937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.852473 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.853937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.852571 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 06:17:42.857736 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.857717 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.860008 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.859854 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 06:17:42.860506 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.860487 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 06:17:42.860506 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.860500 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 06:17:42.860885 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.860868 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 06:17:42.862068 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.862053 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dwspp\"" Jul 21 06:17:42.862068 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.862063 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 06:17:42.862449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.862430 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 06:17:42.862512 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.862480 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 06:17:42.883027 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.883000 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c86fc" Jul 21 06:17:42.890594 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.890570 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c86fc" Jul 21 06:17:42.943918 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.943900 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 06:17:42.951233 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovn-node-metrics-cert\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.951359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951255 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:42.951359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-run\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.951456 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3d17367-f5b8-49d2-9468-84cb73ea78db-hosts-file\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.951456 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-multus-certs\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.951456 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951449 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-multus-certs\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951461 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-run\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951470 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e3d17367-f5b8-49d2-9468-84cb73ea78db-hosts-file\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6149349e-ba6d-4171-bb14-992eb1916b1e-agent-certs\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951566 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.951597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56t6k\" (UniqueName: \"kubernetes.io/projected/bd536a99-1717-4e99-b2df-4127807bcb27-kube-api-access-56t6k\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ba51b6-3821-4fd6-9624-be00cd8859e2-host-slash\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-tmp\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-etc-tuned\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-daemon-config\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.951863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951882 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-kubelet-config\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd536a99-1717-4e99-b2df-4127807bcb27-serviceca\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951955 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-bin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.951980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-conf-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952008 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgpc\" (UniqueName: \"kubernetes.io/projected/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kube-api-access-msgpc\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952032 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952054 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-script-lib\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952178 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysconfig\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952223 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-bin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952245 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-conf-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-multus\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952244 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cnibin\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952344 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cnibin\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysconfig\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952387 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63ba51b6-3821-4fd6-9624-be00cd8859e2-host-slash\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952455 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-cni-multus\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952499 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-log-socket\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-bin\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952577 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-env-overrides\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d17367-f5b8-49d2-9468-84cb73ea78db-tmp-dir\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-lib-modules\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-kubelet\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952688 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvq6g\" (UniqueName: \"kubernetes.io/projected/d6d0eb93-3794-4ae0-8ae2-db985ce71001-kube-api-access-lvq6g\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-daemon-config\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-kubelet\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952776 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-var-lib-kubelet\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.952913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952821 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd536a99-1717-4e99-b2df-4127807bcb27-serviceca\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952874 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3d17367-f5b8-49d2-9468-84cb73ea78db-tmp-dir\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952936 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-lib-modules\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.952979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-netns\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-modprobe-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-systemd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74pm\" (UniqueName: \"kubernetes.io/projected/a7af2564-40d3-41c4-a85f-046991fd670a-kube-api-access-d74pm\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953204 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-modprobe-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-netns\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-hostroot\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-socket-dir-parent\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6149349e-ba6d-4171-bb14-992eb1916b1e-konnectivity-ca\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953334 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-systemd-units\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953334 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-netns\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.953794 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953379 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-hostroot\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63ba51b6-3821-4fd6-9624-be00cd8859e2-iptables-alerter-script\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-multus-socket-dir-parent\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-system-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-sys\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953598 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953623 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953650 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cni-binary-copy\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953667 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-system-cni-dir\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-os-release\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5xw\" (UniqueName: \"kubernetes.io/projected/63ba51b6-3821-4fd6-9624-be00cd8859e2-kube-api-access-7x5xw\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953723 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-device-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-sys\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953750 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-etc-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-ovn\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953778 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-os-release\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.954431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953823 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-d\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.955011 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmq8m\" (UniqueName: \"kubernetes.io/projected/c286da15-b3f5-4ecb-b065-9451fa1f6506-kube-api-access-nmq8m\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.956462 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.956438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-etc-tuned\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.956567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.956456 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6149349e-ba6d-4171-bb14-992eb1916b1e-konnectivity-ca\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.956856 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.956835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.956955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.956857 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6149349e-ba6d-4171-bb14-992eb1916b1e-agent-certs\") pod \"konnectivity-agent-5gnxm\" (UID: \"6149349e-ba6d-4171-bb14-992eb1916b1e\") " pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:42.956955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.953860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-dbus\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:42.957147 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.956950 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63ba51b6-3821-4fd6-9624-be00cd8859e2-iptables-alerter-script\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.957394 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.957514 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-os-release\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.957514 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.957514 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957494 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cni-binary-copy\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.957514 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-slash\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.957742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-node-log\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.957742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v866d\" (UniqueName: \"kubernetes.io/projected/e3d17367-f5b8-49d2-9468-84cb73ea78db-kube-api-access-v866d\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.957742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-kubernetes\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.957742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957641 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-systemd\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.957742 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957704 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-systemd\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-etc-kubernetes\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957814 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-var-lib-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-netd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957910 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd536a99-1717-4e99-b2df-4127807bcb27-host\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957909 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-os-release\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.957976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cnibin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957998 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-etc-kubernetes\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.957991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-conf\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-var-lib-kubelet\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958107 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-host\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958173 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-k8s-cni-cncf-io\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958178 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-system-cni-dir\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958215 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958218 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-host-run-k8s-cni-cncf-io\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd536a99-1717-4e99-b2df-4127807bcb27-host\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958293 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6d0eb93-3794-4ae0-8ae2-db985ce71001-cnibin\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t89mm\" (UniqueName: \"kubernetes.io/projected/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-kube-api-access-t89mm\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtgq\" (UniqueName: \"kubernetes.io/projected/984533da-66c0-4ed2-b59c-7258adfb3890-kube-api-access-kdtgq\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-kubernetes\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.958368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958361 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-var-lib-kubelet\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958387 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-config\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958459 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-etc-sysctl-conf\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.958127 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.958590 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:43.458543162 +0000 UTC m=+2.039324355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958738 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7af2564-40d3-41c4-a85f-046991fd670a-host\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.959049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.958759 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a7af2564-40d3-41c4-a85f-046991fd670a-tmp\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.959379 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.959316 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.959978 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.959957 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56t6k\" (UniqueName: \"kubernetes.io/projected/bd536a99-1717-4e99-b2df-4127807bcb27-kube-api-access-56t6k\") pod \"node-ca-pv2mz\" (UID: \"bd536a99-1717-4e99-b2df-4127807bcb27\") " pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:42.964348 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.964327 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:42.964424 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.964352 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:42.964424 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.964365 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:42.964491 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:42.964475 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:43.464459183 +0000 UTC m=+2.045240386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:42.966901 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.966875 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvq6g\" (UniqueName: \"kubernetes.io/projected/d6d0eb93-3794-4ae0-8ae2-db985ce71001-kube-api-access-lvq6g\") pod \"multus-2td7f\" (UID: \"d6d0eb93-3794-4ae0-8ae2-db985ce71001\") " pod="openshift-multus/multus-2td7f" Jul 21 06:17:42.967702 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.967684 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5xw\" (UniqueName: \"kubernetes.io/projected/63ba51b6-3821-4fd6-9624-be00cd8859e2-kube-api-access-7x5xw\") pod \"iptables-alerter-k97df\" (UID: \"63ba51b6-3821-4fd6-9624-be00cd8859e2\") " pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:42.968377 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.968355 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t89mm\" (UniqueName: \"kubernetes.io/projected/26b5216b-a3ca-44e6-9c99-1ddb9e584b59-kube-api-access-t89mm\") pod \"multus-additional-cni-plugins-l5h5p\" (UID: \"26b5216b-a3ca-44e6-9c99-1ddb9e584b59\") " pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:42.968472 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.968363 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v866d\" (UniqueName: \"kubernetes.io/projected/e3d17367-f5b8-49d2-9468-84cb73ea78db-kube-api-access-v866d\") pod \"node-resolver-lcvbx\" (UID: \"e3d17367-f5b8-49d2-9468-84cb73ea78db\") " pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:42.968472 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.968464 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtgq\" (UniqueName: \"kubernetes.io/projected/984533da-66c0-4ed2-b59c-7258adfb3890-kube-api-access-kdtgq\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:42.968814 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.968797 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74pm\" (UniqueName: \"kubernetes.io/projected/a7af2564-40d3-41c4-a85f-046991fd670a-kube-api-access-d74pm\") pod \"tuned-wsxqq\" (UID: \"a7af2564-40d3-41c4-a85f-046991fd670a\") " pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:42.971082 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:42.971059 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cfe80bb4d2d5959e89e104d7b84b44.slice/crio-d596569206a58e03dc46d773908359e2848a09408ac39e24d5a324067d28eb75 WatchSource:0}: Error finding container d596569206a58e03dc46d773908359e2848a09408ac39e24d5a324067d28eb75: Status 404 returned error can't find the container with id d596569206a58e03dc46d773908359e2848a09408ac39e24d5a324067d28eb75 Jul 21 06:17:42.975298 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:42.975280 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 06:17:43.003978 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.003952 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c5f08313d5b925e981af86d9cc424a.slice/crio-5bd8827b58bbf71473fcc256c81f44caa14344eeaafb71c14735dabdbf927ad1 WatchSource:0}: Error finding container 5bd8827b58bbf71473fcc256c81f44caa14344eeaafb71c14735dabdbf927ad1: Status 404 returned error can't find the container with id 5bd8827b58bbf71473fcc256c81f44caa14344eeaafb71c14735dabdbf927ad1 Jul 21 06:17:43.059174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059145 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059175 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-config\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovn-node-metrics-cert\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.059313 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059311 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059360 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059324 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.059389 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:43.559369312 +0000 UTC m=+2.140150500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059366 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059459 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-kubelet-config\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgpc\" (UniqueName: \"kubernetes.io/projected/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kube-api-access-msgpc\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059518 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-socket-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059490 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-sys-fs\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-script-lib\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059545 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-kubelet-config\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-log-socket\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059576 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-ovn-kubernetes\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059615 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-log-socket\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-bin\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059728 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-env-overrides\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-kubelet\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-netns\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059798 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-bin\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.059970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059824 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-kubelet\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059832 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-run-netns\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059847 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-config\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-systemd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-systemd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059958 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.059986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-systemd-units\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060067 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovnkube-script-lib\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060052 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-device-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060129 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-systemd-units\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-etc-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060153 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c286da15-b3f5-4ecb-b065-9451fa1f6506-env-overrides\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060165 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-etc-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060176 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-device-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-ovn\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060207 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-run-ovn\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060252 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-registration-dir\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.060670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq8m\" (UniqueName: \"kubernetes.io/projected/c286da15-b3f5-4ecb-b065-9451fa1f6506-kube-api-access-nmq8m\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-dbus\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-slash\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060352 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-dbus\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-node-log\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-slash\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-var-lib-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060417 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-var-lib-openvswitch\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-netd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-node-log\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.060450 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c286da15-b3f5-4ecb-b065-9451fa1f6506-host-cni-netd\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.061746 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.061727 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c286da15-b3f5-4ecb-b065-9451fa1f6506-ovn-node-metrics-cert\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.073460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.073431 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgpc\" (UniqueName: \"kubernetes.io/projected/20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6-kube-api-access-msgpc\") pod \"aws-ebs-csi-driver-node-jhfvm\" (UID: \"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.073558 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.073480 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq8m\" (UniqueName: \"kubernetes.io/projected/c286da15-b3f5-4ecb-b065-9451fa1f6506-kube-api-access-nmq8m\") pod \"ovnkube-node-jd96j\" (UID: \"c286da15-b3f5-4ecb-b065-9451fa1f6506\") " pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.138143 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.138106 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:43.159934 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.159909 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k97df" Jul 21 06:17:43.169786 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.169766 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ba51b6_3821_4fd6_9624_be00cd8859e2.slice/crio-43757dc3d4475c0d02e53a36c1e879a577a9ab551e7f86f8696378c3d9c5cce1 WatchSource:0}: Error finding container 43757dc3d4475c0d02e53a36c1e879a577a9ab551e7f86f8696378c3d9c5cce1: Status 404 returned error can't find the container with id 43757dc3d4475c0d02e53a36c1e879a577a9ab551e7f86f8696378c3d9c5cce1 Jul 21 06:17:43.180902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.180875 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pv2mz" Jul 21 06:17:43.189301 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.189276 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd536a99_1717_4e99_b2df_4127807bcb27.slice/crio-c4cc435ec6d1fb262e35763840e2bd4bc8da533899782b9c5c50c0cf5b08a45f WatchSource:0}: Error finding container c4cc435ec6d1fb262e35763840e2bd4bc8da533899782b9c5c50c0cf5b08a45f: Status 404 returned error can't find the container with id c4cc435ec6d1fb262e35763840e2bd4bc8da533899782b9c5c50c0cf5b08a45f Jul 21 06:17:43.194514 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.194495 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2td7f" Jul 21 06:17:43.203433 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.203398 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d0eb93_3794_4ae0_8ae2_db985ce71001.slice/crio-352b8089020fcf3b75ee3aaff5285558f304ef3fdf1d06ede1f51d6b2c20730c WatchSource:0}: Error finding container 352b8089020fcf3b75ee3aaff5285558f304ef3fdf1d06ede1f51d6b2c20730c: Status 404 returned error can't find the container with id 352b8089020fcf3b75ee3aaff5285558f304ef3fdf1d06ede1f51d6b2c20730c Jul 21 06:17:43.208606 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.208589 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" Jul 21 06:17:43.216557 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.216527 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b5216b_a3ca_44e6_9c99_1ddb9e584b59.slice/crio-0a079a67bef9a63af4f7c1d9b05b69e2adbd0ce84c8153463eae2eef3a274281 WatchSource:0}: Error finding container 0a079a67bef9a63af4f7c1d9b05b69e2adbd0ce84c8153463eae2eef3a274281: Status 404 returned error can't find the container with id 0a079a67bef9a63af4f7c1d9b05b69e2adbd0ce84c8153463eae2eef3a274281 Jul 21 06:17:43.222856 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.222836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:17:43.229874 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.229824 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lcvbx" Jul 21 06:17:43.232218 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.232197 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6149349e_ba6d_4171_bb14_992eb1916b1e.slice/crio-015e6d47fcb72fea87ccd75715709db7b366591b990df9aaa5589d6328260eed WatchSource:0}: Error finding container 015e6d47fcb72fea87ccd75715709db7b366591b990df9aaa5589d6328260eed: Status 404 returned error can't find the container with id 015e6d47fcb72fea87ccd75715709db7b366591b990df9aaa5589d6328260eed Jul 21 06:17:43.238065 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.238043 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d17367_f5b8_49d2_9468_84cb73ea78db.slice/crio-e3b058d1f25e047278948e5fffd19b6229c4107410a216f52db840a343781fb3 WatchSource:0}: Error finding container e3b058d1f25e047278948e5fffd19b6229c4107410a216f52db840a343781fb3: Status 404 returned error can't find the container with id e3b058d1f25e047278948e5fffd19b6229c4107410a216f52db840a343781fb3 Jul 21 06:17:43.248171 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.248149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" Jul 21 06:17:43.256865 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.256834 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7af2564_40d3_41c4_a85f_046991fd670a.slice/crio-cf97b51b4706d26f6da364743b4fb08a051769e370d920945db2a70077e7654b WatchSource:0}: Error finding container cf97b51b4706d26f6da364743b4fb08a051769e370d920945db2a70077e7654b: Status 404 returned error can't find the container with id cf97b51b4706d26f6da364743b4fb08a051769e370d920945db2a70077e7654b Jul 21 06:17:43.281153 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.281129 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" Jul 21 06:17:43.285958 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.285941 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:17:43.290709 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.290688 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20781cd6_6ec0_4d28_8bd8_52ed59ee5fb6.slice/crio-5754e2815bb2d71cbe86b77197e64ee1ab9ea03db16a27c9c03c3c6bcea80d8d WatchSource:0}: Error finding container 5754e2815bb2d71cbe86b77197e64ee1ab9ea03db16a27c9c03c3c6bcea80d8d: Status 404 returned error can't find the container with id 5754e2815bb2d71cbe86b77197e64ee1ab9ea03db16a27c9c03c3c6bcea80d8d Jul 21 06:17:43.297175 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:17:43.295102 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc286da15_b3f5_4ecb_b065_9451fa1f6506.slice/crio-ba1fbf05ccd8130ca258297e49234b051dfa003ef17a81a2a7a0f7cde7df9f7a WatchSource:0}: Error finding container ba1fbf05ccd8130ca258297e49234b051dfa003ef17a81a2a7a0f7cde7df9f7a: Status 404 returned error can't find the container with id ba1fbf05ccd8130ca258297e49234b051dfa003ef17a81a2a7a0f7cde7df9f7a Jul 21 06:17:43.463666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.463573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:43.463805 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.463723 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:43.463805 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.463790 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:44.463774074 +0000 UTC m=+3.044555251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:43.564857 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.564817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:43.565059 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.564903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:43.565114 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565061 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:43.565114 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565084 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:43.565114 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565098 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:43.565400 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565192 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:44.565153724 +0000 UTC m=+3.145934918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:43.565400 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565310 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:43.565530 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.565406 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:44.565368954 +0000 UTC m=+3.146150146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:43.621281 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.621063 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:43.893714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.893584 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 06:12:43 +0000 UTC" deadline="2028-01-10 04:34:38.218995985 +0000 UTC" Jul 21 06:17:43.893714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.893657 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12910h16m54.325342989s" Jul 21 06:17:43.959271 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.959238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:43.959453 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.959391 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:43.959940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.959917 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:43.960039 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:43.960020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:43.987257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.968373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" event={"ID":"a7af2564-40d3-41c4-a85f-046991fd670a","Type":"ContainerStarted","Data":"cf97b51b4706d26f6da364743b4fb08a051769e370d920945db2a70077e7654b"} Jul 21 06:17:43.987257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.971077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5gnxm" event={"ID":"6149349e-ba6d-4171-bb14-992eb1916b1e","Type":"ContainerStarted","Data":"015e6d47fcb72fea87ccd75715709db7b366591b990df9aaa5589d6328260eed"} Jul 21 06:17:43.987257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.973637 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerStarted","Data":"0a079a67bef9a63af4f7c1d9b05b69e2adbd0ce84c8153463eae2eef3a274281"} Jul 21 06:17:43.987257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.980007 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pv2mz" event={"ID":"bd536a99-1717-4e99-b2df-4127807bcb27","Type":"ContainerStarted","Data":"c4cc435ec6d1fb262e35763840e2bd4bc8da533899782b9c5c50c0cf5b08a45f"} Jul 21 06:17:44.002024 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.989256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k97df" event={"ID":"63ba51b6-3821-4fd6-9624-be00cd8859e2","Type":"ContainerStarted","Data":"43757dc3d4475c0d02e53a36c1e879a577a9ab551e7f86f8696378c3d9c5cce1"} Jul 21 06:17:44.002024 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:43.999224 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" event={"ID":"f7c5f08313d5b925e981af86d9cc424a","Type":"ContainerStarted","Data":"5bd8827b58bbf71473fcc256c81f44caa14344eeaafb71c14735dabdbf927ad1"} Jul 21 06:17:44.006496 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.006463 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" event={"ID":"d9cfe80bb4d2d5959e89e104d7b84b44","Type":"ContainerStarted","Data":"d596569206a58e03dc46d773908359e2848a09408ac39e24d5a324067d28eb75"} Jul 21 06:17:44.026738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.026686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" event={"ID":"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6","Type":"ContainerStarted","Data":"5754e2815bb2d71cbe86b77197e64ee1ab9ea03db16a27c9c03c3c6bcea80d8d"} Jul 21 06:17:44.030271 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.030238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lcvbx" event={"ID":"e3d17367-f5b8-49d2-9468-84cb73ea78db","Type":"ContainerStarted","Data":"e3b058d1f25e047278948e5fffd19b6229c4107410a216f52db840a343781fb3"} Jul 21 06:17:44.032948 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.032917 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2td7f" event={"ID":"d6d0eb93-3794-4ae0-8ae2-db985ce71001","Type":"ContainerStarted","Data":"352b8089020fcf3b75ee3aaff5285558f304ef3fdf1d06ede1f51d6b2c20730c"} Jul 21 06:17:44.035538 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.035513 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"ba1fbf05ccd8130ca258297e49234b051dfa003ef17a81a2a7a0f7cde7df9f7a"} Jul 21 06:17:44.472748 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.472703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:44.472941 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.472873 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:44.472941 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.472941 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.472919629 +0000 UTC m=+5.053700822 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.574049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.574131 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574306 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574326 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574340 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574408 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.57438537 +0000 UTC m=+5.155166566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574841 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:44.574940 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.574900 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.574880956 +0000 UTC m=+5.155662149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:44.895320 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.894761 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 06:12:43 +0000 UTC" deadline="2028-04-22 16:58:17.871832046 +0000 UTC" Jul 21 06:17:44.895320 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.894798 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15394h40m32.97703829s" Jul 21 06:17:44.956932 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:44.956374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:44.956932 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:44.956516 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:45.888172 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:45.888136 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 06:17:45.958491 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:45.958408 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:45.959011 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:45.958539 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:45.959011 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:45.958925 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:45.959139 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:45.959039 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:46.491402 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:46.491329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:46.491610 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.491519 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:46.491678 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.491616 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:50.491593133 +0000 UTC m=+9.072374327 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:46.592584 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:46.592546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:46.592790 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:46.592632 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:46.593521 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.592884 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:46.593521 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.592914 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:46.593521 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.592931 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:46.593521 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.592992 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:50.592971718 +0000 UTC m=+9.173752907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:46.593521 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.593488 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:46.593844 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.593547 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:50.593530731 +0000 UTC m=+9.174311906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:46.956735 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:46.956110 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:46.956735 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:46.956282 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:47.956578 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:47.956533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:47.957062 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:47.956688 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:47.957152 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:47.957107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:47.957345 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:47.957313 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:48.956751 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:48.956711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:48.957279 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:48.956866 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:49.958413 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:49.958377 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:49.958852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:49.958497 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:49.958852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:49.958816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:49.958943 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:49.958907 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:50.528022 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:50.527980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:50.528240 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.528198 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:50.528331 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.528280 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:58.528255468 +0000 UTC m=+17.109036660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:50.628424 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:50.628383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:50.628582 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:50.628491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:50.628661 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628611 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:50.628661 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628626 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:50.628661 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628635 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:50.628661 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628650 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:50.628866 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628693 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:58.628672481 +0000 UTC m=+17.209453658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:50.628866 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.628712 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:58.628699821 +0000 UTC m=+17.209480999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:50.956527 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:50.956445 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:50.956684 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:50.956582 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:51.957458 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:51.957418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:51.957964 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:51.957543 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:51.957964 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:51.957602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:51.957964 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:51.957726 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:52.956426 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:52.956388 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:52.956585 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:52.956535 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:53.957390 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:53.956806 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:53.957390 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:53.956942 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:53.957390 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:53.957188 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:53.957390 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:53.957299 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:54.955860 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:54.955831 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:54.956016 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:54.955938 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:55.955877 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:55.955836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:55.956310 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:55.955950 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:55.956310 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:55.956027 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:55.956310 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:55.956133 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:56.956561 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:56.956515 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:56.956966 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:56.956643 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:57.956388 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:57.956352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:57.956593 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:57.956352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:57.956593 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:57.956506 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:57.956593 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:57.956564 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:17:58.593858 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:58.593820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:58.594070 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.593968 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:58.594070 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.594033 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:14.594015067 +0000 UTC m=+33.174796260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:17:58.694410 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:58.694375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:58.694608 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:58.694447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:58.694608 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694555 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:58.694608 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694581 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:17:58.694608 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694609 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:17:58.694784 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694615 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:14.694599972 +0000 UTC m=+33.275381147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:17:58.694784 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694623 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:58.694784 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.694680 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:14.694662749 +0000 UTC m=+33.275443925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:17:58.956707 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:58.956630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:17:58.957215 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:58.956750 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:17:59.955986 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:59.955956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:17:59.956193 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:17:59.955955 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:17:59.956193 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:59.956069 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:17:59.956193 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:17:59.956171 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:00.956160 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:00.956069 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:00.956537 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:00.956199 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:01.957251 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:01.957204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:01.957722 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:01.957354 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:01.957722 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:01.957414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:01.957722 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:01.957541 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:02.955982 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:02.955945 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:02.956195 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:02.956087 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:03.956594 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:03.956551 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:03.957035 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:03.956565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:03.957035 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:03.956700 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:03.957035 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:03.956767 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:04.956841 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:04.956665 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:04.957199 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:04.956921 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:05.099488 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.098794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" event={"ID":"f7c5f08313d5b925e981af86d9cc424a","Type":"ContainerStarted","Data":"1e3150e1b4843ad0575474d71de7b0bcf7e690bbe4a18f7053636533660581f7"} Jul 21 06:18:05.102069 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.101867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2td7f" event={"ID":"d6d0eb93-3794-4ae0-8ae2-db985ce71001","Type":"ContainerStarted","Data":"d2059c57b98bea81b733a3cdba77e1c51e6739fa6a3017ec8561214fa45ed353"} Jul 21 06:18:05.104390 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104267 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:18:05.104711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104688 2572 generic.go:356] "Generic (PLEG): container finished" podID="c286da15-b3f5-4ecb-b065-9451fa1f6506" containerID="2685d07230457e5af1c410bc5048dde42578ad72e6658d0199da6d98273963b6" exitCode=1 Jul 21 06:18:05.104795 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104758 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"58793abb6b7d0a145e86b45820aaa02256e2c23e3ade3eb71e9eb4ed41cb6064"} Jul 21 06:18:05.104853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104839 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"af7c0a9848bd4fd988f495ba2aac59cebeaaf68f65a9307fa4f70f8e11ae7345"} Jul 21 06:18:05.104915 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerDied","Data":"2685d07230457e5af1c410bc5048dde42578ad72e6658d0199da6d98273963b6"} Jul 21 06:18:05.104971 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.104956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"eef1360f0570daed003439ba99c24950389a648b14da4ad0365f2bb0c7b531e2"} Jul 21 06:18:05.106547 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.106142 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" event={"ID":"a7af2564-40d3-41c4-a85f-046991fd670a","Type":"ContainerStarted","Data":"fa227484e65999a74573a67ec8b037465879f0d2df6894202dd9ccc06297b04a"} Jul 21 06:18:05.113766 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.113710 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-215.ec2.internal" podStartSLOduration=22.113691283 podStartE2EDuration="22.113691283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:05.113514178 +0000 UTC m=+23.694295374" watchObservedRunningTime="2026-07-21 06:18:05.113691283 +0000 UTC m=+23.694472479" Jul 21 06:18:05.131324 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.131279 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2td7f" podStartSLOduration=1.865555847 podStartE2EDuration="23.131263336s" totalImagesPullingTime="21.265707489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:05.130739505 +0000 UTC m=+23.711520698" watchObservedRunningTime="2026-07-21 06:18:05.131263336 +0000 UTC m=+23.712044529" Jul 21 06:18:05.147347 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.147259 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wsxqq" podStartSLOduration=1.9923708420000001 podStartE2EDuration="23.147242409s" totalImagesPullingTime="21.154871567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:05.147243134 +0000 UTC m=+23.728024327" watchObservedRunningTime="2026-07-21 06:18:05.147242409 +0000 UTC m=+23.728023603" Jul 21 06:18:05.956839 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.956764 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:05.956839 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:05.956789 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:05.957698 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:05.956898 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:05.957698 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:05.957402 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:06.110729 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.110700 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:18:06.111143 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.111099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"75b05bccc76dbb5f1f175eec06e32c4133eef2ba54d6d2b0a1b6e6e81dc653a4"} Jul 21 06:18:06.111216 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.111192 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"5bfcbe85f1f4bb3c40c86503150fae38720e1e9214a1e3263197a1a2e0393511"} Jul 21 06:18:06.112418 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.112391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5gnxm" event={"ID":"6149349e-ba6d-4171-bb14-992eb1916b1e","Type":"ContainerStarted","Data":"6a10413a01f602ee871421453ccf134e56b075defe47c238f3aa7ea7817a5806"} Jul 21 06:18:06.113851 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.113829 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="33eb6c9aa8f5745dff9e4ffc863dab6bb4166c4e3584b649d88f18c76cbc3225" exitCode=0 Jul 21 06:18:06.113945 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.113911 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"33eb6c9aa8f5745dff9e4ffc863dab6bb4166c4e3584b649d88f18c76cbc3225"} Jul 21 06:18:06.115299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.115273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pv2mz" event={"ID":"bd536a99-1717-4e99-b2df-4127807bcb27","Type":"ContainerStarted","Data":"e0c46bf87fde28cf6e25004e3b79a8de61bbaed6a38256aec2fb316fa4d5444d"} Jul 21 06:18:06.116916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.116896 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k97df" event={"ID":"63ba51b6-3821-4fd6-9624-be00cd8859e2","Type":"ContainerStarted","Data":"8ba18bc8371cbc63d98e2d5c0d30824bd412d1ba37652e6b2949857a31874d8a"} Jul 21 06:18:06.118299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.118277 2572 generic.go:356] "Generic (PLEG): container finished" podID="d9cfe80bb4d2d5959e89e104d7b84b44" containerID="97c0e069a66d4f31036b5496696b600cefb3fed9c83f82d70a34b2de3c4870f8" exitCode=0 Jul 21 06:18:06.118387 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.118304 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" event={"ID":"d9cfe80bb4d2d5959e89e104d7b84b44","Type":"ContainerDied","Data":"97c0e069a66d4f31036b5496696b600cefb3fed9c83f82d70a34b2de3c4870f8"} Jul 21 06:18:06.119820 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.119785 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" event={"ID":"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6","Type":"ContainerStarted","Data":"12a5b1efc9b05b2333833bfc375e476ae735c63200caa14803eda194d3949cc2"} Jul 21 06:18:06.121195 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.121174 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lcvbx" event={"ID":"e3d17367-f5b8-49d2-9468-84cb73ea78db","Type":"ContainerStarted","Data":"1efb9aeef1e8ed27fd96c7108f29bb4292ea7bee8331f68c878ef80b1e7e3695"} Jul 21 06:18:06.126750 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.126710 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5gnxm" podStartSLOduration=11.036699018 podStartE2EDuration="24.126698351s" totalImagesPullingTime="13.089999333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.126306878 +0000 UTC m=+24.707088073" watchObservedRunningTime="2026-07-21 06:18:06.126698351 +0000 UTC m=+24.707479544" Jul 21 06:18:06.169335 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.169138 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k97df" podStartSLOduration=6.770762057 podStartE2EDuration="24.169104746s" totalImagesPullingTime="17.398342689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.153726667 +0000 UTC m=+24.734507860" watchObservedRunningTime="2026-07-21 06:18:06.169104746 +0000 UTC m=+24.749885939" Jul 21 06:18:06.169735 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.169692 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pv2mz" podStartSLOduration=2.966394743 podStartE2EDuration="24.169680532s" totalImagesPullingTime="21.203285789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.168968087 +0000 UTC m=+24.749749281" watchObservedRunningTime="2026-07-21 06:18:06.169680532 +0000 UTC m=+24.750461727" Jul 21 06:18:06.201975 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.201934 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lcvbx" podStartSLOduration=3.047206715 podStartE2EDuration="24.201918711s" totalImagesPullingTime="21.154711996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.201558093 +0000 UTC m=+24.782339286" watchObservedRunningTime="2026-07-21 06:18:06.201918711 +0000 UTC m=+24.782699904" Jul 21 06:18:06.484149 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.484107 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 06:18:06.908970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.908864 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T06:18:06.48414318Z","UUID":"0410c4ba-f63f-439e-a396-41516c5dbb64","Handler":null,"Name":"","Endpoint":""} Jul 21 06:18:06.910716 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.910686 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 06:18:06.910852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.910752 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 06:18:06.956327 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:06.956297 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:06.956505 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:06.956419 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:07.125852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.125811 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" event={"ID":"d9cfe80bb4d2d5959e89e104d7b84b44","Type":"ContainerStarted","Data":"92b31f1aa47ea7cfc03756ca2bc7be03859e7e9e0148fcf3b9fb21a34aa5dfce"} Jul 21 06:18:07.128310 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.128273 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" event={"ID":"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6","Type":"ContainerStarted","Data":"1d1773bc874513658befd028bf96d3099edde5c86b3774c428961f03f10040ff"} Jul 21 06:18:07.142486 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.142336 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-215.ec2.internal" podStartSLOduration=24.142316512 podStartE2EDuration="24.142316512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:07.141197494 +0000 UTC m=+25.721978690" watchObservedRunningTime="2026-07-21 06:18:07.142316512 +0000 UTC m=+25.723097707" Jul 21 06:18:07.234986 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.234905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:18:07.956568 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.956540 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:07.956710 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:07.956669 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:07.957184 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:07.957162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:07.957337 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:07.957313 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:08.133490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:08.133461 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:18:08.133935 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:08.133908 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"f7d281f5a6bb17ea3dedd0fe459af1479b6b3581552168fb0cc3f909a4bfe293"} Jul 21 06:18:08.136102 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:08.136072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" event={"ID":"20781cd6-6ec0-4d28-8bd8-52ed59ee5fb6","Type":"ContainerStarted","Data":"fa2df72bec1379828171b154d829012aef3aec0013bd82da44c3bb0fd789edca"} Jul 21 06:18:08.156448 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:08.156391 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jhfvm" podStartSLOduration=2.448461594 podStartE2EDuration="26.156369648s" totalImagesPullingTime="23.707908054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:08.154553805 +0000 UTC m=+26.735335026" watchObservedRunningTime="2026-07-21 06:18:08.156369648 +0000 UTC m=+26.737150841" Jul 21 06:18:08.956678 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:08.956638 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:08.956901 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:08.956791 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:09.202690 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:09.202656 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:18:09.203373 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:09.203356 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:18:09.955925 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:09.955891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:09.956147 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:09.956020 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:09.956147 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:09.956083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:09.956239 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:09.956214 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:10.141831 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:10.141768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5gnxm" Jul 21 06:18:10.956609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:10.956572 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:10.957017 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:10.956695 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:11.147308 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.147174 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:18:11.147708 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.147683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"02465e6c552c56f18e207cf01999ec7ad95b2edd97ffa203f6fb814eb45ec6db"} Jul 21 06:18:11.147916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.147896 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:11.147972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.147963 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:11.148151 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.148133 2572 scope.go:117] "RemoveContainer" containerID="2685d07230457e5af1c410bc5048dde42578ad72e6658d0199da6d98273963b6" Jul 21 06:18:11.164129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.164095 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:11.956490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.956454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:11.956759 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:11.956549 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:11.956759 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:11.956602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:11.956759 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:11.956685 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:12.153001 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.152973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:18:12.153376 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.153353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" event={"ID":"c286da15-b3f5-4ecb-b065-9451fa1f6506","Type":"ContainerStarted","Data":"b785a19a34eab9e7626ea4fd4cc240031875f5bfbc387c14ab2522baa06f8405"} Jul 21 06:18:12.153540 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.153520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:12.155192 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.155163 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="6496e89aea611f56b15f20c975c332296464f14607c487de51c676676e9a1fad" exitCode=0 Jul 21 06:18:12.155301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.155219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"6496e89aea611f56b15f20c975c332296464f14607c487de51c676676e9a1fad"} Jul 21 06:18:12.169758 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.169737 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:12.180846 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.180806 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" podStartSLOduration=8.003230232 podStartE2EDuration="29.18079417s" totalImagesPullingTime="21.177563938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:12.178553456 +0000 UTC m=+30.759334649" watchObservedRunningTime="2026-07-21 06:18:12.18079417 +0000 UTC m=+30.761575364" Jul 21 06:18:12.956562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:12.956532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:12.956802 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:12.956673 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:13.010220 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.010191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvzgb"] Jul 21 06:18:13.016036 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.015998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vmpc6"] Jul 21 06:18:13.016195 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.016138 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:13.016318 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:13.016265 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:13.016679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.016647 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cfb2j"] Jul 21 06:18:13.016756 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.016723 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:13.016835 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:13.016812 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:13.157586 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:13.157556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:13.157747 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:13.157675 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:14.162478 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.162263 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="0d2d58117d4694699bc3d66990b72f04fd199223d081fbd6b25d566f9049655b" exitCode=0 Jul 21 06:18:14.163083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.162339 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"0d2d58117d4694699bc3d66990b72f04fd199223d081fbd6b25d566f9049655b"} Jul 21 06:18:14.621906 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.621871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:14.622107 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.622023 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:18:14.622107 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.622085 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:46.622062954 +0000 UTC m=+65.202844127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 06:18:14.722222 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.722185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:14.722375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.722237 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:14.722375 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722349 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 06:18:14.722375 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722351 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 06:18:14.722375 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722362 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 06:18:14.722375 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722375 2572 projected.go:196] Error preparing data for projected volume kube-api-access-2tzr4 for pod openshift-network-diagnostics/network-check-target-cfb2j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:18:14.722538 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722413 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4 podName:2124d29b-591e-41a2-aaf3-cc2eb7eea6f3 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:46.722400781 +0000 UTC m=+65.303181966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2tzr4" (UniqueName: "kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4") pod "network-check-target-cfb2j" (UID: "2124d29b-591e-41a2-aaf3-cc2eb7eea6f3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 06:18:14.722538 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.722426 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret podName:ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:46.722420227 +0000 UTC m=+65.303201398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret") pod "global-pull-secret-syncer-vvzgb" (UID: "ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7") : object "kube-system"/"original-pull-secret" not registered Jul 21 06:18:14.956338 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.956264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:14.956338 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.956318 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:14.956503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:14.956342 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:14.956503 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.956431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:14.956503 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.956466 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:14.956600 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:14.956549 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:16.169422 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:16.169391 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="e9ccfec89646bbfa6d16d06b433fe23e788eb9ce60fdcd5953254d9654f44f34" exitCode=0 Jul 21 06:18:16.169811 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:16.169451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"e9ccfec89646bbfa6d16d06b433fe23e788eb9ce60fdcd5953254d9654f44f34"} Jul 21 06:18:16.955854 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:16.955813 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:16.955854 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:16.955837 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:16.956096 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:16.955842 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:16.956096 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:16.955965 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vmpc6" podUID="984533da-66c0-4ed2-b59c-7258adfb3890" Jul 21 06:18:16.956096 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:16.956063 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvzgb" podUID="ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7" Jul 21 06:18:16.956231 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:16.956153 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cfb2j" podUID="2124d29b-591e-41a2-aaf3-cc2eb7eea6f3" Jul 21 06:18:17.715892 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.715822 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-215.ec2.internal" event="NodeReady" Jul 21 06:18:17.716303 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.715970 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 06:18:17.748064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.748030 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:18:17.752577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.752556 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq"] Jul 21 06:18:17.756342 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.756303 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw"] Jul 21 06:18:17.756465 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.756415 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.756548 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.756535 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.759511 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.759904 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760031 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7fwwp\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760050 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760316 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760324 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760356 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq"] Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760435 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j7h2x\"" Jul 21 06:18:17.760679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.760579 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.766231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.764025 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg"] Jul 21 06:18:17.766231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.764442 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.766231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.765796 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 06:18:17.766231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.765850 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.766753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.766723 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fk76m\"" Jul 21 06:18:17.768169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.767202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.768169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.767583 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-28snx"] Jul 21 06:18:17.768169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.767968 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.768465 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.768375 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:17.768757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.768737 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 06:18:17.769718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.769431 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 06:18:17.769718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.769437 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 06:18:17.771084 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.770184 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.771084 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.770370 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-s96sm\"" Jul 21 06:18:17.772744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.772721 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5"] Jul 21 06:18:17.775841 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.775822 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 06:18:17.776186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.776168 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.776687 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.776661 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kl5n2\"" Jul 21 06:18:17.778225 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.776914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.778225 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.777411 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 06:18:17.784377 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.783878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:17.786757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.786727 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.786919 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.786882 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.787257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.787100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2hltg\"" Jul 21 06:18:17.788039 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.787609 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 06:18:17.788999 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.788343 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 06:18:17.788999 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.788410 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw"] Jul 21 06:18:17.789339 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.789296 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:17.792851 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.792706 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq"] Jul 21 06:18:17.792851 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.792818 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:17.792924 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.792862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.793056 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.793042 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 06:18:17.793490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.793467 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.793582 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.793489 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 21 06:18:17.793953 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.793935 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 06:18:17.795763 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.795745 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6m2m5\"" Jul 21 06:18:17.795868 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.795835 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 06:18:17.796073 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.796055 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs"] Jul 21 06:18:17.796197 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.796185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" Jul 21 06:18:17.798822 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.798803 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.798918 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.798808 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tzvlv\"" Jul 21 06:18:17.799250 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.799055 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.799360 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.799336 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5zdrr"] Jul 21 06:18:17.799583 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.799565 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.802103 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.802085 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 21 06:18:17.803050 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.803033 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfkp"] Jul 21 06:18:17.803200 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.803185 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:17.804368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.804344 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 21 06:18:17.804457 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.804432 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 21 06:18:17.804457 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.804444 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 21 06:18:17.805608 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.805590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 06:18:17.805717 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.805676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 06:18:17.805941 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.805925 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sp2g\"" Jul 21 06:18:17.806334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806317 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq"] Jul 21 06:18:17.806428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806353 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw"] Jul 21 06:18:17.806428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806381 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:18:17.806428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806399 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-28snx"] Jul 21 06:18:17.806428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806435 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806439 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806471 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806486 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806502 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806540 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806563 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zdrr"] Jul 21 06:18:17.806625 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.806589 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfkp"] Jul 21 06:18:17.808774 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.808730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 06:18:17.809071 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.809055 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rjnwl\"" Jul 21 06:18:17.809182 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.809093 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 06:18:17.809341 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.809323 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 06:18:17.847387 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847416 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcd8546-0593-43c4-afe6-dfd5600fdde1-config\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.847534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fhg\" (UniqueName: \"kubernetes.io/projected/7fcd8546-0593-43c4-afe6-dfd5600fdde1-kube-api-access-d9fhg\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.847534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847469 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7x2\" (UniqueName: \"kubernetes.io/projected/da1a418b-e8a6-4f91-9333-d6d0dd173464-kube-api-access-bq7x2\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847598 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4qkf\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcd8546-0593-43c4-afe6-dfd5600fdde1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.847753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.848019 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk9sd\" (UniqueName: \"kubernetes.io/projected/ed8aa00d-6bf0-494e-84ca-931f86b9abc6-kube-api-access-qk9sd\") pod \"volume-data-source-validator-78cf4c6f6-kpflq\" (UID: \"ed8aa00d-6bf0-494e-84ca-931f86b9abc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" Jul 21 06:18:17.848019 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.847790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.948657 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948667 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43a9b77-6779-4dba-925c-c59e1e49e0ef-cert\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948726 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7x2\" (UniqueName: \"kubernetes.io/projected/da1a418b-e8a6-4f91-9333-d6d0dd173464-kube-api-access-bq7x2\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.948835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-tmp\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9p5w\" (UniqueName: \"kubernetes.io/projected/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-kube-api-access-x9p5w\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:17.948902 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrrd\" (UniqueName: \"kubernetes.io/projected/850e0b88-c667-421c-abc9-cb49d0f226d8-kube-api-access-gcrrd\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:17.948925 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.948951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:17.948989 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:18.448966338 +0000 UTC m=+37.029747509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p8nm\" (UniqueName: \"kubernetes.io/projected/65e18821-e28d-4411-ac15-0fbd04ce5b95-kube-api-access-7p8nm\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:17.949027 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:17.949105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949069 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/850e0b88-c667-421c-abc9-cb49d0f226d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv5sd\" (UniqueName: \"kubernetes.io/projected/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-kube-api-access-fv5sd\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949161 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-klusterlet-config\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:17.949195 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:18.449177679 +0000 UTC m=+37.029958854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk9sd\" (UniqueName: \"kubernetes.io/projected/ed8aa00d-6bf0-494e-84ca-931f86b9abc6-kube-api-access-qk9sd\") pod \"volume-data-source-validator-78cf4c6f6-kpflq\" (UID: \"ed8aa00d-6bf0-494e-84ca-931f86b9abc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949295 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949301 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949330 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8jjv\" (UniqueName: \"kubernetes.io/projected/59bc2245-4ae7-4bff-98d9-91ee40f3974d-kube-api-access-x8jjv\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-config\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc2245-4ae7-4bff-98d9-91ee40f3974d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.949609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949524 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fhg\" (UniqueName: \"kubernetes.io/projected/7fcd8546-0593-43c4-afe6-dfd5600fdde1-kube-api-access-d9fhg\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e18821-e28d-4411-ac15-0fbd04ce5b95-config-volume\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4qkf\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949661 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e18821-e28d-4411-ac15-0fbd04ce5b95-tmp-dir\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/453673c2-aa85-4a01-bca6-76a5918ef8f1-serving-cert\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcd8546-0593-43c4-afe6-dfd5600fdde1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949748 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-trusted-ca\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2654\" (UniqueName: \"kubernetes.io/projected/eaad1760-c9b2-4719-bf91-5e2cd31239dd-kube-api-access-m2654\") pod \"network-check-source-7bc5b6bf85-pg5gq\" (UID: \"eaad1760-c9b2-4719-bf91-5e2cd31239dd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjfn\" (UniqueName: \"kubernetes.io/projected/a43a9b77-6779-4dba-925c-c59e1e49e0ef-kube-api-access-pqjfn\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.949866 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p25l\" (UniqueName: \"kubernetes.io/projected/453673c2-aa85-4a01-bca6-76a5918ef8f1-kube-api-access-4p25l\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:17.950267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.950028 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.950768 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.950363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcd8546-0593-43c4-afe6-dfd5600fdde1-config\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.950768 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.950577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.951202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.951127 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fcd8546-0593-43c4-afe6-dfd5600fdde1-config\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.953991 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.953947 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fcd8546-0593-43c4-afe6-dfd5600fdde1-serving-cert\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.954152 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.954019 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.954152 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.954019 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.959933 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.959905 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7x2\" (UniqueName: \"kubernetes.io/projected/da1a418b-e8a6-4f91-9333-d6d0dd173464-kube-api-access-bq7x2\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:17.960964 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.960240 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fhg\" (UniqueName: \"kubernetes.io/projected/7fcd8546-0593-43c4-afe6-dfd5600fdde1-kube-api-access-d9fhg\") pod \"service-ca-operator-5bcbc94c78-kxjsq\" (UID: \"7fcd8546-0593-43c4-afe6-dfd5600fdde1\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:17.961209 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.961180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:17.962198 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.962051 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk9sd\" (UniqueName: \"kubernetes.io/projected/ed8aa00d-6bf0-494e-84ca-931f86b9abc6-kube-api-access-qk9sd\") pod \"volume-data-source-validator-78cf4c6f6-kpflq\" (UID: \"ed8aa00d-6bf0-494e-84ca-931f86b9abc6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" Jul 21 06:18:17.962198 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:17.962062 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4qkf\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:18.051623 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-tmp\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.051623 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p5w\" (UniqueName: \"kubernetes.io/projected/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-kube-api-access-x9p5w\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051681 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrrd\" (UniqueName: \"kubernetes.io/projected/850e0b88-c667-421c-abc9-cb49d0f226d8-kube-api-access-gcrrd\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p8nm\" (UniqueName: \"kubernetes.io/projected/65e18821-e28d-4411-ac15-0fbd04ce5b95-kube-api-access-7p8nm\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/850e0b88-c667-421c-abc9-cb49d0f226d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv5sd\" (UniqueName: \"kubernetes.io/projected/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-kube-api-access-fv5sd\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.051834 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-klusterlet-config\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8jjv\" (UniqueName: \"kubernetes.io/projected/59bc2245-4ae7-4bff-98d9-91ee40f3974d-kube-api-access-x8jjv\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051895 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-config\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.051985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc2245-4ae7-4bff-98d9-91ee40f3974d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052026 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e18821-e28d-4411-ac15-0fbd04ce5b95-config-volume\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-tmp\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.052146 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052076 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e18821-e28d-4411-ac15-0fbd04ce5b95-tmp-dir\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052159 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/453673c2-aa85-4a01-bca6-76a5918ef8f1-serving-cert\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052188 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-trusted-ca\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052212 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2654\" (UniqueName: \"kubernetes.io/projected/eaad1760-c9b2-4719-bf91-5e2cd31239dd-kube-api-access-m2654\") pod \"network-check-source-7bc5b6bf85-pg5gq\" (UID: \"eaad1760-c9b2-4719-bf91-5e2cd31239dd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052290 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjfn\" (UniqueName: \"kubernetes.io/projected/a43a9b77-6779-4dba-925c-c59e1e49e0ef-kube-api-access-pqjfn\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p25l\" (UniqueName: \"kubernetes.io/projected/453673c2-aa85-4a01-bca6-76a5918ef8f1-kube-api-access-4p25l\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052369 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43a9b77-6779-4dba-925c-c59e1e49e0ef-cert\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:18.052562 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052400 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.053169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052664 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e18821-e28d-4411-ac15-0fbd04ce5b95-config-volume\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.053169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052894 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e18821-e28d-4411-ac15-0fbd04ce5b95-tmp-dir\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.053169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.052931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.053169 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.052978 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:18.053169 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.053044 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:18.553027008 +0000 UTC m=+37.133808187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:18.053409 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.053205 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/59bc2245-4ae7-4bff-98d9-91ee40f3974d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.054573 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.053597 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-config\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.055223 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.054929 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/453673c2-aa85-4a01-bca6-76a5918ef8f1-trusted-ca\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.055223 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.054945 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-ca\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.055223 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.054952 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.055455 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.055398 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.055642 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.055594 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-klusterlet-config\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.056647 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.056619 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/850e0b88-c667-421c-abc9-cb49d0f226d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:18.056647 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.056624 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a43a9b77-6779-4dba-925c-c59e1e49e0ef-cert\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:18.056955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.056926 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/59bc2245-4ae7-4bff-98d9-91ee40f3974d-hub\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.057166 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.057147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/453673c2-aa85-4a01-bca6-76a5918ef8f1-serving-cert\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.057314 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.057296 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.059955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.059908 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv5sd\" (UniqueName: \"kubernetes.io/projected/70f9c31b-a808-449e-a2ee-dc4d44f9f3b1-kube-api-access-fv5sd\") pod \"kube-storage-version-migrator-operator-7658d9b749-t29dg\" (UID: \"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.061972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.061327 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p8nm\" (UniqueName: \"kubernetes.io/projected/65e18821-e28d-4411-ac15-0fbd04ce5b95-kube-api-access-7p8nm\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.061972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.061334 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8jjv\" (UniqueName: \"kubernetes.io/projected/59bc2245-4ae7-4bff-98d9-91ee40f3974d-kube-api-access-x8jjv\") pod \"cluster-proxy-proxy-agent-98fc9cbc-w5zgs\" (UID: \"59bc2245-4ae7-4bff-98d9-91ee40f3974d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.061972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.061919 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrrd\" (UniqueName: \"kubernetes.io/projected/850e0b88-c667-421c-abc9-cb49d0f226d8-kube-api-access-gcrrd\") pod \"managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw\" (UID: \"850e0b88-c667-421c-abc9-cb49d0f226d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:18.062195 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.062008 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9p5w\" (UniqueName: \"kubernetes.io/projected/7da2201d-bdda-4e95-a8b0-7ccf386f7fbc-kube-api-access-x9p5w\") pod \"klusterlet-addon-workmgr-866b59467c-h7mw5\" (UID: \"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.062620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.062596 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjfn\" (UniqueName: \"kubernetes.io/projected/a43a9b77-6779-4dba-925c-c59e1e49e0ef-kube-api-access-pqjfn\") pod \"ingress-canary-7tfkp\" (UID: \"a43a9b77-6779-4dba-925c-c59e1e49e0ef\") " pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:18.062749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.062730 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p25l\" (UniqueName: \"kubernetes.io/projected/453673c2-aa85-4a01-bca6-76a5918ef8f1-kube-api-access-4p25l\") pod \"console-operator-565b7b569d-28snx\" (UID: \"453673c2-aa85-4a01-bca6-76a5918ef8f1\") " pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.063842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.063826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2654\" (UniqueName: \"kubernetes.io/projected/eaad1760-c9b2-4719-bf91-5e2cd31239dd-kube-api-access-m2654\") pod \"network-check-source-7bc5b6bf85-pg5gq\" (UID: \"eaad1760-c9b2-4719-bf91-5e2cd31239dd\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" Jul 21 06:18:18.097883 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.097852 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" Jul 21 06:18:18.113002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.112984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" Jul 21 06:18:18.119532 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.119510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" Jul 21 06:18:18.127007 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.126986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:18.142235 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.139286 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:18.156302 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.156272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" Jul 21 06:18:18.162764 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.162742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" Jul 21 06:18:18.174159 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.169557 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:18:18.198694 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.195271 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7tfkp" Jul 21 06:18:18.259240 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.257994 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6"] Jul 21 06:18:18.266782 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.266757 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6"] Jul 21 06:18:18.267083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.267014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.272945 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.272923 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-whj4k\"" Jul 21 06:18:18.273205 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.273180 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 06:18:18.273504 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.273485 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 06:18:18.362001 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.361805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0a6ff90-3814-4b93-a2f7-99150297df4a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.362001 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.361880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.392608 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.392498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:18.425147 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.424804 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq"] Jul 21 06:18:18.433008 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.431789 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-28snx"] Jul 21 06:18:18.450622 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.445510 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg"] Jul 21 06:18:18.450622 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.448140 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq"] Jul 21 06:18:18.450622 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.450449 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw"] Jul 21 06:18:18.460854 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.459255 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fcd8546_0593_43c4_afe6_dfd5600fdde1.slice/crio-1f09b9ded7f86a95e9341285a67a8a738df7d2f98183d33e942a66c3daf664a6 WatchSource:0}: Error finding container 1f09b9ded7f86a95e9341285a67a8a738df7d2f98183d33e942a66c3daf664a6: Status 404 returned error can't find the container with id 1f09b9ded7f86a95e9341285a67a8a738df7d2f98183d33e942a66c3daf664a6 Jul 21 06:18:18.460854 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.460564 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod850e0b88_c667_421c_abc9_cb49d0f226d8.slice/crio-ce97c3995cf066883eebf2b362df13e1767aec0c61e6278e21256ff9828344d3 WatchSource:0}: Error finding container ce97c3995cf066883eebf2b362df13e1767aec0c61e6278e21256ff9828344d3: Status 404 returned error can't find the container with id ce97c3995cf066883eebf2b362df13e1767aec0c61e6278e21256ff9828344d3 Jul 21 06:18:18.463086 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.463062 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0a6ff90-3814-4b93-a2f7-99150297df4a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.463217 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.463142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.463217 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.463198 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:18.463311 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.463242 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:18.463402 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.463386 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:18.463465 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.463447 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:19.463426854 +0000 UTC m=+38.044208040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:18.464410 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.464391 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:18.464503 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.464447 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:18.96443077 +0000 UTC m=+37.545211956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:18.464680 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.464518 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:18.464680 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.464529 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:18.464680 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.464566 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:19.464550795 +0000 UTC m=+38.045331969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:18.464680 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.464627 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b0a6ff90-3814-4b93-a2f7-99150297df4a-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.468009 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.467983 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f9c31b_a808_449e_a2ee_dc4d44f9f3b1.slice/crio-4026e412cd1a9baeb3ef4cdfbfe25f27127deecc03a1a0d14cec005d65a3df4f WatchSource:0}: Error finding container 4026e412cd1a9baeb3ef4cdfbfe25f27127deecc03a1a0d14cec005d65a3df4f: Status 404 returned error can't find the container with id 4026e412cd1a9baeb3ef4cdfbfe25f27127deecc03a1a0d14cec005d65a3df4f Jul 21 06:18:18.482417 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.482392 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq"] Jul 21 06:18:18.484575 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.484543 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaad1760_c9b2_4719_bf91_5e2cd31239dd.slice/crio-f1d8504e5925451ab2423bc760f508aaa40a800248b5a943b0f1489b464a06a7 WatchSource:0}: Error finding container f1d8504e5925451ab2423bc760f508aaa40a800248b5a943b0f1489b464a06a7: Status 404 returned error can't find the container with id f1d8504e5925451ab2423bc760f508aaa40a800248b5a943b0f1489b464a06a7 Jul 21 06:18:18.496340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.496303 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5"] Jul 21 06:18:18.496989 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.496964 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:18.506246 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.501779 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7tfkp"] Jul 21 06:18:18.506246 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.503797 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs"] Jul 21 06:18:18.506246 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.504712 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43a9b77_6779_4dba_925c_c59e1e49e0ef.slice/crio-b1b9e8fe327396c0f6bc5e12dd398b99d2d6ac96c3864560e653c47aca52ec2c WatchSource:0}: Error finding container b1b9e8fe327396c0f6bc5e12dd398b99d2d6ac96c3864560e653c47aca52ec2c: Status 404 returned error can't find the container with id b1b9e8fe327396c0f6bc5e12dd398b99d2d6ac96c3864560e653c47aca52ec2c Jul 21 06:18:18.508433 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:18.508405 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59bc2245_4ae7_4bff_98d9_91ee40f3974d.slice/crio-4c9eba48c093b5eaaba760da9fffaf1e85b3727532224e7044c16a570c8e9ca4 WatchSource:0}: Error finding container 4c9eba48c093b5eaaba760da9fffaf1e85b3727532224e7044c16a570c8e9ca4: Status 404 returned error can't find the container with id 4c9eba48c093b5eaaba760da9fffaf1e85b3727532224e7044c16a570c8e9ca4 Jul 21 06:18:18.564179 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.564074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:18.564336 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.564252 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:18.564390 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.564333 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:19.564310059 +0000 UTC m=+38.145091231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:18.592065 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.592038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:18.956211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.956135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:18.956976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.956218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:18.956976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.956609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:18.959968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.959471 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 06:18:18.959968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.959555 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 06:18:18.959968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.959778 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rpb4\"" Jul 21 06:18:18.959968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.959838 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8684r\"" Jul 21 06:18:18.967632 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:18.967604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:18.967859 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.967843 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:18.967911 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:18.967903 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:19.967883519 +0000 UTC m=+38.548664691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:19.187615 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.187569 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerStarted","Data":"4c9eba48c093b5eaaba760da9fffaf1e85b3727532224e7044c16a570c8e9ca4"} Jul 21 06:18:19.191940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.191819 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" event={"ID":"850e0b88-c667-421c-abc9-cb49d0f226d8","Type":"ContainerStarted","Data":"ce97c3995cf066883eebf2b362df13e1767aec0c61e6278e21256ff9828344d3"} Jul 21 06:18:19.204804 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.204771 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tfkp" event={"ID":"a43a9b77-6779-4dba-925c-c59e1e49e0ef","Type":"ContainerStarted","Data":"b1b9e8fe327396c0f6bc5e12dd398b99d2d6ac96c3864560e653c47aca52ec2c"} Jul 21 06:18:19.209213 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.207639 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" event={"ID":"eaad1760-c9b2-4719-bf91-5e2cd31239dd","Type":"ContainerStarted","Data":"f1d8504e5925451ab2423bc760f508aaa40a800248b5a943b0f1489b464a06a7"} Jul 21 06:18:19.211037 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.210956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-28snx" event={"ID":"453673c2-aa85-4a01-bca6-76a5918ef8f1","Type":"ContainerStarted","Data":"d8221278256603ef96d70839dc723b27897274fdb8331b7118be5f036ae0ed68"} Jul 21 06:18:19.214626 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.214566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" event={"ID":"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1","Type":"ContainerStarted","Data":"4026e412cd1a9baeb3ef4cdfbfe25f27127deecc03a1a0d14cec005d65a3df4f"} Jul 21 06:18:19.218440 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.218364 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" event={"ID":"ed8aa00d-6bf0-494e-84ca-931f86b9abc6","Type":"ContainerStarted","Data":"d8f4390921e62b8a164bd841324b1a3b4f8c57bc3fff136e8b7d1c39911f9dc1"} Jul 21 06:18:19.220264 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.220202 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" event={"ID":"7fcd8546-0593-43c4-afe6-dfd5600fdde1","Type":"ContainerStarted","Data":"1f09b9ded7f86a95e9341285a67a8a738df7d2f98183d33e942a66c3daf664a6"} Jul 21 06:18:19.222178 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.222100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" event={"ID":"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc","Type":"ContainerStarted","Data":"6b87933db7305e9fea7a8bf40f18ca222ac5f51e073a34f5de29437de43c7c94"} Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.473716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.474086 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.474272 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.474340 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:21.474320281 +0000 UTC m=+40.055101467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.474414 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.474425 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:19.474852 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.474454 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:21.474444274 +0000 UTC m=+40.055225469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:19.576148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.575675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:19.576148 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.575843 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:19.576148 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.575907 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:21.575887852 +0000 UTC m=+40.156669034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:19.980988 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:19.980948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:19.981469 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.981346 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:19.981469 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:19.981414 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:21.981394502 +0000 UTC m=+40.562175694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:21.497105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:21.497064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:21.497640 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:21.497155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:21.497640 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.497390 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:21.497640 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.497456 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:25.497436382 +0000 UTC m=+44.078217569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:21.497888 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.497869 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:21.497946 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.497892 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:21.497946 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.497940 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:25.497924119 +0000 UTC m=+44.078705294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:21.597972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:21.597934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:21.598205 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.598191 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:21.598268 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:21.598259 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:25.598239388 +0000 UTC m=+44.179020575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:21.934891 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:21.934842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:21.985311 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:21.985190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:22.003577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:22.003479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:22.003764 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:22.003630 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:22.003764 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:22.003706 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:26.003685775 +0000 UTC m=+44.584466949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:23.368864 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:23.368720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:23.468857 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:23.468822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:24.118817 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:24.118757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:24.218986 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:24.218945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:25.536331 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:25.536298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:25.536451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.536485 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.536561 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.536573 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:33.536550675 +0000 UTC m=+52.117331850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.536577 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:25.536799 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.536619 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:33.536605791 +0000 UTC m=+52.117386963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:25.637223 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:25.637184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:25.637405 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.637366 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:25.637535 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:25.637435 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:33.637417001 +0000 UTC m=+52.218198173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:26.041892 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:26.041848 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:26.042091 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:26.042030 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:26.042173 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:26.042107 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:34.042087158 +0000 UTC m=+52.622868329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:28.442044 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:28.442004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:28.492165 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:28.492093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:29.989724 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:29.989678 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:30.039071 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:30.039020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:31.167561 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:31.167519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:31.238281 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:31.238244 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:33.276226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.275738 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" event={"ID":"7fcd8546-0593-43c4-afe6-dfd5600fdde1","Type":"ContainerStarted","Data":"fde579335a8669d0360ece9962e6ca15c87143c74c578b4ddbe6508abefe9166"} Jul 21 06:18:33.277450 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.277419 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" event={"ID":"7da2201d-bdda-4e95-a8b0-7ccf386f7fbc","Type":"ContainerStarted","Data":"8fec33200315ba7ec87191f1728876580eb9e55f6dc354f4bbf840f980a58f7b"} Jul 21 06:18:33.277593 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.277563 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:33.279137 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.279092 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" Jul 21 06:18:33.280164 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.280144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerStarted","Data":"70a53fcdb8b26289d959dafe8696109b7b275f080f246e18bc3156e40a8d0664"} Jul 21 06:18:33.280278 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.280177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerStarted","Data":"33d8e400a41f2fd005dafb5062feb0b55a8dddb0cecb373c59c8053c8f508280"} Jul 21 06:18:33.280278 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.280195 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerStarted","Data":"9b491d4afb09466a52182fe8ec02a3950a1cbfac2d0e1f9ae77b5f203ac57a3f"} Jul 21 06:18:33.283177 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.283152 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="634fc0d8d59095385414ab744d08c59e4ece96e5b84412323b5e31075c9cd3a9" exitCode=0 Jul 21 06:18:33.283291 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.283231 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"634fc0d8d59095385414ab744d08c59e4ece96e5b84412323b5e31075c9cd3a9"} Jul 21 06:18:33.285057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.285034 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7tfkp" event={"ID":"a43a9b77-6779-4dba-925c-c59e1e49e0ef","Type":"ContainerStarted","Data":"450c96c349c17470adc00d4396437a8eeb76ffcb0ef14b249b44103e898b71a5"} Jul 21 06:18:33.286767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.286745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" event={"ID":"eaad1760-c9b2-4719-bf91-5e2cd31239dd","Type":"ContainerStarted","Data":"ce31810db60d227069e8a879d013051051ecd482c77cfdf44becfa092dd678b6"} Jul 21 06:18:33.288638 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.288621 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/0.log" Jul 21 06:18:33.288737 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.288658 2572 generic.go:356] "Generic (PLEG): container finished" podID="453673c2-aa85-4a01-bca6-76a5918ef8f1" containerID="e1bc414cff6af912dbb1f1b64fa0673677e64b03d7a9fc3bb5300717bfce7fdd" exitCode=255 Jul 21 06:18:33.288737 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.288729 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-28snx" event={"ID":"453673c2-aa85-4a01-bca6-76a5918ef8f1","Type":"ContainerDied","Data":"e1bc414cff6af912dbb1f1b64fa0673677e64b03d7a9fc3bb5300717bfce7fdd"} Jul 21 06:18:33.288913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.288896 2572 scope.go:117] "RemoveContainer" containerID="e1bc414cff6af912dbb1f1b64fa0673677e64b03d7a9fc3bb5300717bfce7fdd" Jul 21 06:18:33.292639 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.292602 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" podStartSLOduration=31.510209935 podStartE2EDuration="45.29258793s" totalImagesPullingTime="13.782377995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.292512975 +0000 UTC m=+51.873294167" watchObservedRunningTime="2026-07-21 06:18:33.29258793 +0000 UTC m=+51.873369130" Jul 21 06:18:33.293077 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.293052 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" event={"ID":"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1","Type":"ContainerStarted","Data":"9fe21c8047127a80f365e0f16a9d991df3ba84e2096f3de063ac07dd62cc657e"} Jul 21 06:18:33.294981 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.294919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" event={"ID":"ed8aa00d-6bf0-494e-84ca-931f86b9abc6","Type":"ContainerStarted","Data":"96735fe6a1c679dba731e53efcb9f6be92e0637a75f5b5b9b1cf642b17a32bc0"} Jul 21 06:18:33.327267 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.327209 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-866b59467c-h7mw5" podStartSLOduration=30.589882519 podStartE2EDuration="44.327188856s" totalImagesPullingTime="13.737306337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.326665112 +0000 UTC m=+51.907446308" watchObservedRunningTime="2026-07-21 06:18:33.327188856 +0000 UTC m=+51.907970051" Jul 21 06:18:33.367642 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.367588 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-pg5gq" podStartSLOduration=21.608877351 podStartE2EDuration="35.367566213s" totalImagesPullingTime="13.758688862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.345832418 +0000 UTC m=+51.926613615" watchObservedRunningTime="2026-07-21 06:18:33.367566213 +0000 UTC m=+51.948347405" Jul 21 06:18:33.385654 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.385391 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" podStartSLOduration=30.638206942 podStartE2EDuration="44.385369482s" totalImagesPullingTime="13.74716254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.385167662 +0000 UTC m=+51.965948856" watchObservedRunningTime="2026-07-21 06:18:33.385369482 +0000 UTC m=+51.966150657" Jul 21 06:18:33.402444 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.402395 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7tfkp" podStartSLOduration=2.6668540050000002 podStartE2EDuration="16.402376096s" totalImagesPullingTime="13.735522091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.402158066 +0000 UTC m=+51.982939265" watchObservedRunningTime="2026-07-21 06:18:33.402376096 +0000 UTC m=+51.983157291" Jul 21 06:18:33.421791 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.420846 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-kpflq" podStartSLOduration=31.710194508 podStartE2EDuration="45.420827382s" totalImagesPullingTime="13.710632874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.420169268 +0000 UTC m=+52.000950460" watchObservedRunningTime="2026-07-21 06:18:33.420827382 +0000 UTC m=+52.001608577" Jul 21 06:18:33.436654 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.436598 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" podStartSLOduration=31.758551096 podStartE2EDuration="45.436576742s" totalImagesPullingTime="13.678025646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:33.436054523 +0000 UTC m=+52.016835718" watchObservedRunningTime="2026-07-21 06:18:33.436576742 +0000 UTC m=+52.017357937" Jul 21 06:18:33.491369 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.491314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:33.536580 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.536501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:33.612853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.612815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:33.613032 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.612864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:33.613032 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.612967 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 06:18:33.613032 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.612981 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b994b5b8-hbn54: secret "image-registry-tls" not found Jul 21 06:18:33.613032 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.613032 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls podName:b75e39dc-9591-4a27-9309-a67e03a53767 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:49.613019201 +0000 UTC m=+68.193800373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls") pod "image-registry-68b994b5b8-hbn54" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767") : secret "image-registry-tls" not found Jul 21 06:18:33.613253 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.613032 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 06:18:33.613253 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.613090 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls podName:da1a418b-e8a6-4f91-9333-d6d0dd173464 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:49.613076221 +0000 UTC m=+68.193857393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-qprbw" (UID: "da1a418b-e8a6-4f91-9333-d6d0dd173464") : secret "samples-operator-tls" not found Jul 21 06:18:33.713431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.713393 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:33.713621 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.713565 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 06:18:33.713678 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:33.713645 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls podName:65e18821-e28d-4411-ac15-0fbd04ce5b95 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:49.713621569 +0000 UTC m=+68.294402754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls") pod "dns-default-5zdrr" (UID: "65e18821-e28d-4411-ac15-0fbd04ce5b95") : secret "dns-default-metrics-tls" not found Jul 21 06:18:33.723916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.723884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:33.824132 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:33.824024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:34.116983 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.116885 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:34.117192 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:34.117048 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 06:18:34.117192 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:34.117158 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert podName:b0a6ff90-3814-4b93-a2f7-99150297df4a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:50.117142581 +0000 UTC m=+68.697923774 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-22pv6" (UID: "b0a6ff90-3814-4b93-a2f7-99150297df4a") : secret "networking-console-plugin-cert" not found Jul 21 06:18:34.156695 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.156657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:34.207234 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.207204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:34.305383 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.305344 2572 generic.go:356] "Generic (PLEG): container finished" podID="26b5216b-a3ca-44e6-9c99-1ddb9e584b59" containerID="b72a5ef42f4cf6118f494ed2d8a041491f8729c66743922f6c2638e704f4cd06" exitCode=0 Jul 21 06:18:34.305813 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.305423 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerDied","Data":"b72a5ef42f4cf6118f494ed2d8a041491f8729c66743922f6c2638e704f4cd06"} Jul 21 06:18:34.307043 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307025 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:18:34.307419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/0.log" Jul 21 06:18:34.307491 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307435 2572 generic.go:356] "Generic (PLEG): container finished" podID="453673c2-aa85-4a01-bca6-76a5918ef8f1" containerID="b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4" exitCode=255 Jul 21 06:18:34.307491 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-28snx" event={"ID":"453673c2-aa85-4a01-bca6-76a5918ef8f1","Type":"ContainerDied","Data":"b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4"} Jul 21 06:18:34.307567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307530 2572 scope.go:117] "RemoveContainer" containerID="e1bc414cff6af912dbb1f1b64fa0673677e64b03d7a9fc3bb5300717bfce7fdd" Jul 21 06:18:34.307722 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.307695 2572 scope.go:117] "RemoveContainer" containerID="b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4" Jul 21 06:18:34.307885 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:34.307863 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-28snx_openshift-console-operator(453673c2-aa85-4a01-bca6-76a5918ef8f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-28snx" podUID="453673c2-aa85-4a01-bca6-76a5918ef8f1" Jul 21 06:18:34.423396 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.423357 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:34.496635 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.496599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:34.546832 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:34.546803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:35.314958 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.314920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" event={"ID":"26b5216b-a3ca-44e6-9c99-1ddb9e584b59","Type":"ContainerStarted","Data":"db3f51f819b7ce45e2cc6d6bb1d9caad25babb94ec8b073290bffb6215173477"} Jul 21 06:18:35.316450 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.316431 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:18:35.316709 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.316695 2572 scope.go:117] "RemoveContainer" containerID="b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4" Jul 21 06:18:35.316842 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:35.316825 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-28snx_openshift-console-operator(453673c2-aa85-4a01-bca6-76a5918ef8f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-28snx" podUID="453673c2-aa85-4a01-bca6-76a5918ef8f1" Jul 21 06:18:35.337275 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.337223 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l5h5p" podStartSLOduration=12.567157304 podStartE2EDuration="53.337206339s" totalImagesPullingTime="40.770049035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:35.335428935 +0000 UTC m=+53.916210131" watchObservedRunningTime="2026-07-21 06:18:35.337206339 +0000 UTC m=+53.917987533" Jul 21 06:18:35.463291 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.463258 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:35.560273 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:35.560239 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:36.062064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:36.062025 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:36.888127 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:36.888074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:38.128196 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:38.128157 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:38.128588 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:38.128229 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:38.128711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:38.128696 2572 scope.go:117] "RemoveContainer" containerID="b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4" Jul 21 06:18:38.128909 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:38.128886 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-28snx_openshift-console-operator(453673c2-aa85-4a01-bca6-76a5918ef8f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-28snx" podUID="453673c2-aa85-4a01-bca6-76a5918ef8f1" Jul 21 06:18:39.332679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:39.332644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" event={"ID":"850e0b88-c667-421c-abc9-cb49d0f226d8","Type":"ContainerStarted","Data":"4a697e795a1af93a4fe17e74a16d53b2dfad0d1c65e76fbab2a4224d4aeb5e1d"} Jul 21 06:18:39.803522 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:39.803490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:40.933251 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:40.933217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:41.087129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:41.087081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:41.204673 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:41.204575 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:41.416194 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:41.416161 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:41.507605 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:41.507523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:41.667314 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:41.667275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:42.229833 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:42.229784 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:42.840481 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:42.840450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:43.101910 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:43.101828 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:43.437495 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:43.437401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:43.638967 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:43.638925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:43.848186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:43.848155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:44.036016 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:44.035981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:44.183036 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:44.182978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jd96j" Jul 21 06:18:44.213620 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:44.213561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf7c7b88-mgdxw" podStartSLOduration=34.833081243 podStartE2EDuration="55.213542182s" totalImagesPullingTime="20.380460939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:39.347787763 +0000 UTC m=+57.928568970" watchObservedRunningTime="2026-07-21 06:18:44.213542182 +0000 UTC m=+62.794323378" Jul 21 06:18:44.845002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:44.844957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:44.946296 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:44.946252 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:45.072934 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:45.072905 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:45.234264 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:45.234181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:45.436452 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:45.436421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:45.537226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:45.537189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:45.836709 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:45.836619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:46.438322 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.438284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:46.628421 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.628385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:18:46.631189 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.631172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 06:18:46.639469 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:46.639450 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 06:18:46.639530 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:18:46.639504 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs podName:984533da-66c0-4ed2-b59c-7258adfb3890 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:50.639487746 +0000 UTC m=+129.220268918 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs") pod "network-metrics-daemon-vmpc6" (UID: "984533da-66c0-4ed2-b59c-7258adfb3890") : secret "metrics-daemon-secret" not found Jul 21 06:18:46.729082 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.729013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:46.729082 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.729067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:46.731984 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.731959 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 06:18:46.732718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.732698 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzr4\" (UniqueName: \"kubernetes.io/projected/2124d29b-591e-41a2-aaf3-cc2eb7eea6f3-kube-api-access-2tzr4\") pod \"network-check-target-cfb2j\" (UID: \"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3\") " pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:46.741566 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.741544 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7-original-pull-secret\") pod \"global-pull-secret-syncer-vvzgb\" (UID: \"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7\") " pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:46.831181 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.831152 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:46.898830 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.898798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvzgb" Jul 21 06:18:46.920551 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.920517 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8684r\"" Jul 21 06:18:46.928895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:46.928873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:47.041677 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.041651 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvzgb"] Jul 21 06:18:47.043479 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:47.043431 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1b08d3_6c1d_4626_b8c3_f9b516f28bb7.slice/crio-588fb4cb53f0677e865306838e6a5e7f16a6d8001b019ca4df4d0812ccba2cfa WatchSource:0}: Error finding container 588fb4cb53f0677e865306838e6a5e7f16a6d8001b019ca4df4d0812ccba2cfa: Status 404 returned error can't find the container with id 588fb4cb53f0677e865306838e6a5e7f16a6d8001b019ca4df4d0812ccba2cfa Jul 21 06:18:47.062441 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.062417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cfb2j"] Jul 21 06:18:47.065141 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:47.065098 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2124d29b_591e_41a2_aaf3_cc2eb7eea6f3.slice/crio-4a980f8e94c78b79009d3325928f369174da616089f917b06559f8fdb32317af WatchSource:0}: Error finding container 4a980f8e94c78b79009d3325928f369174da616089f917b06559f8fdb32317af: Status 404 returned error can't find the container with id 4a980f8e94c78b79009d3325928f369174da616089f917b06559f8fdb32317af Jul 21 06:18:47.235368 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.235275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:47.353809 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.353777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:47.359427 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.359399 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cfb2j" event={"ID":"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3","Type":"ContainerStarted","Data":"ff9a01db9ec579e48594282e53a5a117644fe4a5d16ff60e22279e9b2d025779"} Jul 21 06:18:47.359582 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.359444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cfb2j" event={"ID":"2124d29b-591e-41a2-aaf3-cc2eb7eea6f3","Type":"ContainerStarted","Data":"4a980f8e94c78b79009d3325928f369174da616089f917b06559f8fdb32317af"} Jul 21 06:18:47.359582 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.359496 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:18:47.360535 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.360515 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvzgb" event={"ID":"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7","Type":"ContainerStarted","Data":"588fb4cb53f0677e865306838e6a5e7f16a6d8001b019ca4df4d0812ccba2cfa"} Jul 21 06:18:47.375997 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.375954 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cfb2j" podStartSLOduration=65.375939618 podStartE2EDuration="1m5.375939618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:47.374481071 +0000 UTC m=+65.955262266" watchObservedRunningTime="2026-07-21 06:18:47.375939618 +0000 UTC m=+65.956720803" Jul 21 06:18:47.455170 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.455137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:47.834644 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:47.834607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:48.437715 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:48.437683 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:48.844082 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:48.844045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:49.238182 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.238079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:49.632550 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.632511 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:49.655576 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.655545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:49.655758 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.655601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:49.658720 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.658695 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"image-registry-68b994b5b8-hbn54\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:49.658831 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.658725 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/da1a418b-e8a6-4f91-9333-d6d0dd173464-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-qprbw\" (UID: \"da1a418b-e8a6-4f91-9333-d6d0dd173464\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:49.756414 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.756371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:49.758771 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.758740 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e18821-e28d-4411-ac15-0fbd04ce5b95-metrics-tls\") pod \"dns-default-5zdrr\" (UID: \"65e18821-e28d-4411-ac15-0fbd04ce5b95\") " pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:49.837895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.837852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:49.889167 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.889078 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j7h2x\"" Jul 21 06:18:49.897449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.897416 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:49.908255 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.908228 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fk76m\"" Jul 21 06:18:49.915575 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.915544 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" Jul 21 06:18:49.991607 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.991567 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sp2g\"" Jul 21 06:18:49.998956 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:49.998926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:50.035350 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.035259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:50.159903 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.159820 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:50.162805 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.162775 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b0a6ff90-3814-4b93-a2f7-99150297df4a-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-22pv6\" (UID: \"b0a6ff90-3814-4b93-a2f7-99150297df4a\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:50.418353 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.418270 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-whj4k\"" Jul 21 06:18:50.425660 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.425627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" Jul 21 06:18:50.838988 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.838940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:50.956852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:50.956820 2572 scope.go:117] "RemoveContainer" containerID="b963f786c49bdbd2e5da57da7d623e27dd08f4ddc47f1babd1e94933d643edf4" Jul 21 06:18:51.036195 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.036166 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:51.248880 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.248741 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:51.476710 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.476679 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:18:51.492494 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:51.492462 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75e39dc_9591_4a27_9309_a67e03a53767.slice/crio-e200f40874a17c6af91e71e04c2196123278a55e36391ea5563b9140e0fe72e8 WatchSource:0}: Error finding container e200f40874a17c6af91e71e04c2196123278a55e36391ea5563b9140e0fe72e8: Status 404 returned error can't find the container with id e200f40874a17c6af91e71e04c2196123278a55e36391ea5563b9140e0fe72e8 Jul 21 06:18:51.701956 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.701918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6"] Jul 21 06:18:51.705486 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.705454 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5zdrr"] Jul 21 06:18:51.706339 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:51.705989 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a6ff90_3814_4b93_a2f7_99150297df4a.slice/crio-171f0a26b3b87c1d4fe83651363d5f0ead61c692529de62f386bbdbb22e15d1e WatchSource:0}: Error finding container 171f0a26b3b87c1d4fe83651363d5f0ead61c692529de62f386bbdbb22e15d1e: Status 404 returned error can't find the container with id 171f0a26b3b87c1d4fe83651363d5f0ead61c692529de62f386bbdbb22e15d1e Jul 21 06:18:51.706745 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:51.706724 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw"] Jul 21 06:18:51.709685 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:18:51.709663 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e18821_e28d_4411_ac15_0fbd04ce5b95.slice/crio-3aacf61a25cb8fb7a0fb11ff1d85ff4d0cac3ff5fb89c0164ea49c53437bb413 WatchSource:0}: Error finding container 3aacf61a25cb8fb7a0fb11ff1d85ff4d0cac3ff5fb89c0164ea49c53437bb413: Status 404 returned error can't find the container with id 3aacf61a25cb8fb7a0fb11ff1d85ff4d0cac3ff5fb89c0164ea49c53437bb413 Jul 21 06:18:52.372912 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.372875 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:52.383182 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.383158 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:18:52.383375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.383268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-28snx" event={"ID":"453673c2-aa85-4a01-bca6-76a5918ef8f1","Type":"ContainerStarted","Data":"b59473bf237ee799b29b041f58de958048a276d200dca9a4777754569bda0630"} Jul 21 06:18:52.385137 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.383838 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:52.385770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.385382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zdrr" event={"ID":"65e18821-e28d-4411-ac15-0fbd04ce5b95","Type":"ContainerStarted","Data":"3aacf61a25cb8fb7a0fb11ff1d85ff4d0cac3ff5fb89c0164ea49c53437bb413"} Jul 21 06:18:52.387677 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.387199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvzgb" event={"ID":"ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7","Type":"ContainerStarted","Data":"2a1af8e944caf3eb89a6a8f3843a5b5c84983b8ce4c7cb747e953bca8bb77210"} Jul 21 06:18:52.388972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.388943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" event={"ID":"da1a418b-e8a6-4f91-9333-d6d0dd173464","Type":"ContainerStarted","Data":"594ade49d5e63c874c286bebef3f14f580500994a224e4cc6fd04aa419b37883"} Jul 21 06:18:52.390357 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.390339 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-28snx" Jul 21 06:18:52.391239 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.391213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" event={"ID":"b0a6ff90-3814-4b93-a2f7-99150297df4a","Type":"ContainerStarted","Data":"171f0a26b3b87c1d4fe83651363d5f0ead61c692529de62f386bbdbb22e15d1e"} Jul 21 06:18:52.392941 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.392918 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" event={"ID":"b75e39dc-9591-4a27-9309-a67e03a53767","Type":"ContainerStarted","Data":"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4"} Jul 21 06:18:52.393024 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.392962 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" event={"ID":"b75e39dc-9591-4a27-9309-a67e03a53767","Type":"ContainerStarted","Data":"e200f40874a17c6af91e71e04c2196123278a55e36391ea5563b9140e0fe72e8"} Jul 21 06:18:52.393220 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.393204 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:18:52.400677 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.400631 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-28snx" podStartSLOduration=50.606468927 podStartE2EDuration="1m4.400614932s" totalImagesPullingTime="13.794146005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:52.399554441 +0000 UTC m=+70.980335651" watchObservedRunningTime="2026-07-21 06:18:52.400614932 +0000 UTC m=+70.981396126" Jul 21 06:18:52.413645 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.413594 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vvzgb" podStartSLOduration=65.063880977 podStartE2EDuration="1m9.413571709s" totalImagesPullingTime="4.349690732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:52.41279626 +0000 UTC m=+70.993577454" watchObservedRunningTime="2026-07-21 06:18:52.413571709 +0000 UTC m=+70.994352882" Jul 21 06:18:52.431550 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.431491 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" podStartSLOduration=69.431475486 podStartE2EDuration="1m9.431475486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:52.430887321 +0000 UTC m=+71.011668542" watchObservedRunningTime="2026-07-21 06:18:52.431475486 +0000 UTC m=+71.012256681" Jul 21 06:18:52.434675 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.434644 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:52.491796 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.491762 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:52.690291 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:52.690198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.051698 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.051664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.153242 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.153205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.449746 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.449650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.550149 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.550079 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.861422 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.861382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:53.909388 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:53.909347 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:54.043038 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.043002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:54.094997 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.094950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:54.405864 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.405777 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zdrr" event={"ID":"65e18821-e28d-4411-ac15-0fbd04ce5b95","Type":"ContainerStarted","Data":"a00f010af5d0f8e31169a4e41194f5fddc8f8258de0b3083f6e8bf6076d780ab"} Jul 21 06:18:54.408323 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.408287 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" event={"ID":"da1a418b-e8a6-4f91-9333-d6d0dd173464","Type":"ContainerStarted","Data":"127a4cd10daf9e63931490a441b7b49a1c4356e9bc6e71d2ac7638c03f4b84fe"} Jul 21 06:18:54.414204 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.414171 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" event={"ID":"b0a6ff90-3814-4b93-a2f7-99150297df4a","Type":"ContainerStarted","Data":"02fe447a98f3dc6adab2cc6e4ef0feb75aba68aeb1940788fd2ee3242a521ada"} Jul 21 06:18:54.431019 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:54.430972 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-22pv6" podStartSLOduration=33.934027917 podStartE2EDuration="36.430957396s" totalImagesPullingTime="2.496929479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:54.430544235 +0000 UTC m=+73.011325430" watchObservedRunningTime="2026-07-21 06:18:54.430957396 +0000 UTC m=+73.011738589" Jul 21 06:18:55.419106 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.419072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5zdrr" event={"ID":"65e18821-e28d-4411-ac15-0fbd04ce5b95","Type":"ContainerStarted","Data":"df08379a399593cca661e74fb462d7205727fcd70668a66b266c9b3c2b8416dd"} Jul 21 06:18:55.419580 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.419203 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5zdrr" Jul 21 06:18:55.420912 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.420888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" event={"ID":"da1a418b-e8a6-4f91-9333-d6d0dd173464","Type":"ContainerStarted","Data":"aace1df6c931df4be4dc39558e5b527662a9afb3f68d66a1244e563a2062eec9"} Jul 21 06:18:55.435866 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.435811 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5zdrr" podStartSLOduration=35.932034775 podStartE2EDuration="38.435790818s" totalImagesPullingTime="2.503756043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:55.4348417 +0000 UTC m=+74.015622895" watchObservedRunningTime="2026-07-21 06:18:55.435790818 +0000 UTC m=+74.016572016" Jul 21 06:18:55.450474 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.450421 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-qprbw" podStartSLOduration=64.994858009 podStartE2EDuration="1m7.450406205s" totalImagesPullingTime="2.455548196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:55.450166356 +0000 UTC m=+74.030947554" watchObservedRunningTime="2026-07-21 06:18:55.450406205 +0000 UTC m=+74.031187398" Jul 21 06:18:55.482416 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.482379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:55.535259 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:55.535213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:57.913685 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:57.913635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:57.961773 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:57.961716 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:58.485534 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:58.485503 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:58.561935 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:58.561901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:58.665873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:58.665841 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:18:58.760577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:18:58.760540 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.007094 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.006943 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.106858 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.106816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.166052 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.166017 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.514507 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.514475 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stvsz"] Jul 21 06:19:04.532039 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.532007 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stvsz"] Jul 21 06:19:04.532249 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.532172 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.534824 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.534800 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 06:19:04.535033 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.535019 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 06:19:04.535145 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.535092 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 06:19:04.536414 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.536393 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 06:19:04.536523 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.536397 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7g9pq\"" Jul 21 06:19:04.542230 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.542210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.581911 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.581880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c7b12f-9a35-4570-9156-82f89a62f52c-data-volume\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.582057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.581927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.582057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.581969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c7b12f-9a35-4570-9156-82f89a62f52c-crio-socket\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.582057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.581999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sdcj\" (UniqueName: \"kubernetes.io/projected/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-api-access-8sdcj\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.582057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.582015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.594512 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.594473 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:04.682570 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c7b12f-9a35-4570-9156-82f89a62f52c-crio-socket\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sdcj\" (UniqueName: \"kubernetes.io/projected/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-api-access-8sdcj\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c7b12f-9a35-4570-9156-82f89a62f52c-data-volume\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682659 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c7b12f-9a35-4570-9156-82f89a62f52c-crio-socket\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:04.682743 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 06:19:04.682767 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:04.682757 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 06:19:04.683012 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:04.682820 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:05.182801193 +0000 UTC m=+83.763582366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : secret "insights-runtime-extractor-tls" not found Jul 21 06:19:04.683012 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:04.682841 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:05.182829413 +0000 UTC m=+83.763610591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : configmap "kube-rbac-proxy" not found Jul 21 06:19:04.683012 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.682986 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c7b12f-9a35-4570-9156-82f89a62f52c-data-volume\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.691171 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.691147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sdcj\" (UniqueName: \"kubernetes.io/projected/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-api-access-8sdcj\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:04.888245 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:04.888162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:05.185603 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:05.185525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:05.185603 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:05.185580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:05.185990 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:05.185651 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 06:19:05.185990 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:05.185684 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 06:19:05.185990 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:05.185714 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:06.185699551 +0000 UTC m=+84.766480723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : configmap "kube-rbac-proxy" not found Jul 21 06:19:05.185990 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:05.185750 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:06.18573634 +0000 UTC m=+84.766517515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : secret "insights-runtime-extractor-tls" not found Jul 21 06:19:05.427194 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:05.427158 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5zdrr" Jul 21 06:19:05.494428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:05.494347 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zdrr_65e18821-e28d-4411-ac15-0fbd04ce5b95/dns/0.log" Jul 21 06:19:05.694164 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:05.694130 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zdrr_65e18821-e28d-4411-ac15-0fbd04ce5b95/kube-rbac-proxy/0.log" Jul 21 06:19:06.192473 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:06.192435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:06.192887 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:06.192520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:06.192887 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:06.192586 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 06:19:06.192887 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:06.192640 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 06:19:06.192887 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:06.192651 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:08.192636198 +0000 UTC m=+86.773417370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : secret "insights-runtime-extractor-tls" not found Jul 21 06:19:06.192887 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:06.192724 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:08.192706833 +0000 UTC m=+86.773488007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : configmap "kube-rbac-proxy" not found Jul 21 06:19:06.641419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:06.641379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:06.694470 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:06.694443 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lcvbx_e3d17367-f5b8-49d2-9468-84cb73ea78db/dns-node-resolver/0.log" Jul 21 06:19:07.094525 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:07.094496 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68b994b5b8-hbn54_b75e39dc-9591-4a27-9309-a67e03a53767/registry/0.log" Jul 21 06:19:07.187193 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:07.187154 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:07.251790 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:07.251749 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:07.694233 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:07.694207 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pv2mz_bd536a99-1717-4e99-b2df-4127807bcb27/node-ca/0.log" Jul 21 06:19:07.860173 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:07.860107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:08.209957 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:08.209920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:08.210286 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:08.209981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:08.210286 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:08.210053 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 06:19:08.210286 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:08.210133 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 06:19:08.210286 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:08.210158 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:12.210134669 +0000 UTC m=+90.790915863 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : configmap "kube-rbac-proxy" not found Jul 21 06:19:08.210286 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:08.210182 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:12.210169706 +0000 UTC m=+90.790950878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : secret "insights-runtime-extractor-tls" not found Jul 21 06:19:08.297949 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:08.297912 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7tfkp_a43a9b77-6779-4dba-925c-c59e1e49e0ef/serve-healthcheck-canary/0.log" Jul 21 06:19:09.277554 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.277517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:09.324985 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.324949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:09.677446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.677349 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:09.722718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.722691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:09.903712 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.903675 2572 patch_prober.go:28] interesting pod/image-registry-68b994b5b8-hbn54 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 06:19:09.903880 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:09.903732 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 06:19:12.245849 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:12.245812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:12.246343 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:12.245899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:12.246343 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:12.245981 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 06:19:12.246343 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:12.246050 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:20.246033026 +0000 UTC m=+98.826814215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : secret "insights-runtime-extractor-tls" not found Jul 21 06:19:12.246343 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:12.245982 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 06:19:12.246343 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:12.246107 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm podName:b1c7b12f-9a35-4570-9156-82f89a62f52c nodeName:}" failed. No retries permitted until 2026-07-21 06:19:20.246093195 +0000 UTC m=+98.826874367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stvsz" (UID: "b1c7b12f-9a35-4570-9156-82f89a62f52c") : configmap "kube-rbac-proxy" not found Jul 21 06:19:12.276324 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:12.276290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:12.377741 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:12.377704 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:13.402669 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:13.402641 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:19:13.692738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:13.692654 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:13.742474 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:13.742430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:14.103801 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:14.103755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:14.286337 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:14.286296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:14.334673 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:14.334639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:17.540560 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:17.540526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:17.641488 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:17.641456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:17.742609 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:17.742576 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:18.107102 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:18.107068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:18.367218 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:18.367147 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cfb2j" Jul 21 06:19:18.496792 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:18.496750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.303348 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.303317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.480703 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.480674 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.552803 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.552772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.557000 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.556929 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vsbbr"] Jul 21 06:19:19.561757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.561739 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.564893 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.564868 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 06:19:19.565002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.564961 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 06:19:19.565002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.564969 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 06:19:19.565131 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.565098 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hsg87\"" Jul 21 06:19:19.566330 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.566308 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 06:19:19.566425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.566328 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 06:19:19.566425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.566309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 06:19:19.605679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605645 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-tls\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.605873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.605873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605706 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fznsn\" (UniqueName: \"kubernetes.io/projected/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-kube-api-access-fznsn\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.605873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605755 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.605873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-root\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.606083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-wtmp\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.606083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-sys\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.606083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.605981 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-metrics-client-ca\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.606083 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.606011 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-textfile\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.656331 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.656297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.707070 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707040 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-wtmp\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-sys\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-metrics-client-ca\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-textfile\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707193 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-sys\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707352 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-wtmp\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707352 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-tls\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707352 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fznsn\" (UniqueName: \"kubernetes.io/projected/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-kube-api-access-fznsn\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707419 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-textfile\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-root\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707651 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707471 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-root\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707779 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707758 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-metrics-client-ca\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.707974 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.707952 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-accelerators-collector-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.709783 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.709766 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-tls\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.709889 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.709868 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.718106 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.718082 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fznsn\" (UniqueName: \"kubernetes.io/projected/e2e52f7d-f6d9-4cec-8f4e-160504c31bf2-kube-api-access-fznsn\") pod \"node-exporter-vsbbr\" (UID: \"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2\") " pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.756236 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.756205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.858605 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.858520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:19.871091 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:19.871067 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vsbbr" Jul 21 06:19:19.882121 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:19:19.882083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e52f7d_f6d9_4cec_8f4e_160504c31bf2.slice/crio-f0e9e42d7847c2acfb9a8fbc3c29d1ee561b06e11cef62f3912d05c8af684e06 WatchSource:0}: Error finding container f0e9e42d7847c2acfb9a8fbc3c29d1ee561b06e11cef62f3912d05c8af684e06: Status 404 returned error can't find the container with id f0e9e42d7847c2acfb9a8fbc3c29d1ee561b06e11cef62f3912d05c8af684e06 Jul 21 06:19:20.313263 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.313219 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:20.313670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.313306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:20.313840 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.313820 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c7b12f-9a35-4570-9156-82f89a62f52c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:20.315690 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.315672 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c7b12f-9a35-4570-9156-82f89a62f52c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stvsz\" (UID: \"b1c7b12f-9a35-4570-9156-82f89a62f52c\") " pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:20.428859 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.428822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:20.441684 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.441655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stvsz" Jul 21 06:19:20.514056 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.513973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vsbbr" event={"ID":"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2","Type":"ContainerStarted","Data":"f0e9e42d7847c2acfb9a8fbc3c29d1ee561b06e11cef62f3912d05c8af684e06"} Jul 21 06:19:20.530469 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.530422 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:20.595811 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.595728 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stvsz"] Jul 21 06:19:20.599069 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.599038 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:20.599781 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:19:20.599753 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c7b12f_9a35_4570_9156_82f89a62f52c.slice/crio-371addf99902ef4553c192abd8b29b7980c75d7aeb4d9d1e192600fc17ec0177 WatchSource:0}: Error finding container 371addf99902ef4553c192abd8b29b7980c75d7aeb4d9d1e192600fc17ec0177: Status 404 returned error can't find the container with id 371addf99902ef4553c192abd8b29b7980c75d7aeb4d9d1e192600fc17ec0177 Jul 21 06:19:20.660819 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:20.660782 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:21.520872 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:21.520834 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2e52f7d-f6d9-4cec-8f4e-160504c31bf2" containerID="6e39a95f94a507d5253cbcb27fcf2413f96ca19e09701a80818442a128f0e43a" exitCode=0 Jul 21 06:19:21.521384 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:21.520927 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vsbbr" event={"ID":"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2","Type":"ContainerDied","Data":"6e39a95f94a507d5253cbcb27fcf2413f96ca19e09701a80818442a128f0e43a"} Jul 21 06:19:21.523559 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:21.523528 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stvsz" event={"ID":"b1c7b12f-9a35-4570-9156-82f89a62f52c","Type":"ContainerStarted","Data":"371addf99902ef4553c192abd8b29b7980c75d7aeb4d9d1e192600fc17ec0177"} Jul 21 06:19:22.504007 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:22.503972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:22.530683 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:22.530644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vsbbr" event={"ID":"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2","Type":"ContainerStarted","Data":"f577adf3a1e918786206e779f8512bf9662f13294499fac7093168b591883462"} Jul 21 06:19:22.531211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:22.530714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vsbbr" event={"ID":"e2e52f7d-f6d9-4cec-8f4e-160504c31bf2","Type":"ContainerStarted","Data":"2413570a261e3a77d1751865e20b8d1e35f33c8cac33855c3eef6e625f45af28"} Jul 21 06:19:22.552740 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:22.552655 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vsbbr" podStartSLOduration=2.4736831280000002 podStartE2EDuration="3.552633601s" totalImagesPullingTime="1.00389216s" totalInitContainerRuntime="75.058313ms" isStatefulPod=true podCreationTimestamp="2026-07-21 06:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:22.549896519 +0000 UTC m=+101.130677710" watchObservedRunningTime="2026-07-21 06:19:22.552633601 +0000 UTC m=+101.133414796" Jul 21 06:19:22.607937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:22.607901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.003991 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.003883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.284692 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.284659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.379360 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.379321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.480363 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.480315 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.560499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.560424 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.628245 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.628202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.784943 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.784902 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:23.888132 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:23.888019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:24.012238 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.012207 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:19:24.099412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.099378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:24.199748 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.199660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:24.335096 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.335056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:24.432169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.432107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:24.558231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:24.558195 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:25.855688 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:25.855645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:25.964745 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:25.964703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:26.549894 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:26.549858 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stvsz" event={"ID":"b1c7b12f-9a35-4570-9156-82f89a62f52c","Type":"ContainerStarted","Data":"bc5c8e6ed9626eab486a5d3ddc2f7a46dba4dbcdb835203f61ad6b1aa471f693"} Jul 21 06:19:26.748856 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:26.748772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:26.798574 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:26.798536 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:28.443976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:28.443939 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:28.544020 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:28.543977 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:30.098067 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:30.098036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:30.198287 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:30.198256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:30.568234 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:30.568200 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stvsz" event={"ID":"b1c7b12f-9a35-4570-9156-82f89a62f52c","Type":"ContainerStarted","Data":"3a3e20984eeaf204bff7df8bc1e674f9dc6233ff6b4d10a378455359f82b206b"} Jul 21 06:19:34.584451 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:34.584411 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stvsz" event={"ID":"b1c7b12f-9a35-4570-9156-82f89a62f52c","Type":"ContainerStarted","Data":"7decc78fb33b4f54b69d72ebe7db3d9e9a416f36fc8d0b62226f47ab4ad6e819"} Jul 21 06:19:34.602056 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:34.602011 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stvsz" podStartSLOduration=17.710710249 podStartE2EDuration="30.601997485s" totalImagesPullingTime="12.891287236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:19:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:34.601082223 +0000 UTC m=+113.181863430" watchObservedRunningTime="2026-07-21 06:19:34.601997485 +0000 UTC m=+113.182778679" Jul 21 06:19:36.258924 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:36.258888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:36.304373 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:36.304335 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:36.861236 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:36.861202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:36.919249 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:36.919215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:39.405282 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:39.405248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:39.505124 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:39.505074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:47.368945 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:47.368909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:47.471560 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:47.471528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:47.524180 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:47.524142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:48.637878 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:48.637839 2572 generic.go:356] "Generic (PLEG): container finished" podID="70f9c31b-a808-449e-a2ee-dc4d44f9f3b1" containerID="9fe21c8047127a80f365e0f16a9d991df3ba84e2096f3de063ac07dd62cc657e" exitCode=0 Jul 21 06:19:48.638270 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:48.637890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" event={"ID":"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1","Type":"ContainerDied","Data":"9fe21c8047127a80f365e0f16a9d991df3ba84e2096f3de063ac07dd62cc657e"} Jul 21 06:19:48.638270 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:48.638220 2572 scope.go:117] "RemoveContainer" containerID="9fe21c8047127a80f365e0f16a9d991df3ba84e2096f3de063ac07dd62cc657e" Jul 21 06:19:49.039386 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.039347 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" containerName="registry" containerID="cri-o://07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4" gracePeriod=30 Jul 21 06:19:49.278840 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.278817 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:19:49.376288 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376198 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376288 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376266 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376288 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376286 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376308 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4qkf\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376325 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376360 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376421 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token\") pod \"b75e39dc-9591-4a27-9309-a67e03a53767\" (UID: \"b75e39dc-9591-4a27-9309-a67e03a53767\") " Jul 21 06:19:49.376801 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376653 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 06:19:49.376990 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.376926 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 06:19:49.379545 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.379070 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:19:49.379545 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.379427 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:19:49.379719 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.379601 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:19:49.379719 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.379676 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:19:49.379827 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.379733 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf" (OuterVolumeSpecName: "kube-api-access-r4qkf") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "kube-api-access-r4qkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:19:49.387234 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.387205 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b75e39dc-9591-4a27-9309-a67e03a53767" (UID: "b75e39dc-9591-4a27-9309-a67e03a53767"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:19:49.477366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477331 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-bound-sa-token\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477358 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-registry-certificates\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477369 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-registry-tls\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477379 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-installation-pull-secrets\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477388 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4qkf\" (UniqueName: \"kubernetes.io/projected/b75e39dc-9591-4a27-9309-a67e03a53767-kube-api-access-r4qkf\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477398 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b75e39dc-9591-4a27-9309-a67e03a53767-image-registry-private-configuration\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477407 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b75e39dc-9591-4a27-9309-a67e03a53767-trusted-ca\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.477577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.477415 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b75e39dc-9591-4a27-9309-a67e03a53767-ca-trust-extracted\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:19:49.643548 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.643441 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-t29dg" event={"ID":"70f9c31b-a808-449e-a2ee-dc4d44f9f3b1","Type":"ContainerStarted","Data":"bb74a83b6776e4be10cfb7c1ea959302b6be82a85fedbaffcbf04d294c570aca"} Jul 21 06:19:49.644611 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.644579 2572 generic.go:356] "Generic (PLEG): container finished" podID="b75e39dc-9591-4a27-9309-a67e03a53767" containerID="07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4" exitCode=0 Jul 21 06:19:49.644725 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.644617 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" Jul 21 06:19:49.644725 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.644619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" event={"ID":"b75e39dc-9591-4a27-9309-a67e03a53767","Type":"ContainerDied","Data":"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4"} Jul 21 06:19:49.644725 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.644669 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b994b5b8-hbn54" event={"ID":"b75e39dc-9591-4a27-9309-a67e03a53767","Type":"ContainerDied","Data":"e200f40874a17c6af91e71e04c2196123278a55e36391ea5563b9140e0fe72e8"} Jul 21 06:19:49.644725 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.644693 2572 scope.go:117] "RemoveContainer" containerID="07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4" Jul 21 06:19:49.654564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.654538 2572 scope.go:117] "RemoveContainer" containerID="07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4" Jul 21 06:19:49.654933 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:19:49.654895 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4\": container with ID starting with 07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4 not found: ID does not exist" containerID="07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4" Jul 21 06:19:49.655097 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.655055 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4"} err="failed to get container status \"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4\": rpc error: code = NotFound desc = could not find container \"07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4\": container with ID starting with 07938f8dc85ce4698f0349a55207602ccc3c96e610570102087d7864b9dfebd4 not found: ID does not exist" Jul 21 06:19:49.674346 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.674313 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:19:49.679429 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.679398 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b994b5b8-hbn54"] Jul 21 06:19:49.960835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:49.960757 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" path="/var/lib/kubelet/pods/b75e39dc-9591-4a27-9309-a67e03a53767/volumes" Jul 21 06:19:50.687980 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.687949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:19:50.690424 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.690398 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984533da-66c0-4ed2-b59c-7258adfb3890-metrics-certs\") pod \"network-metrics-daemon-vmpc6\" (UID: \"984533da-66c0-4ed2-b59c-7258adfb3890\") " pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:19:50.745331 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.745295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:50.813080 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.813051 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rpb4\"" Jul 21 06:19:50.820319 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.820289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vmpc6" Jul 21 06:19:50.846064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.846031 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:50.894581 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.894554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:50.944664 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:50.944626 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vmpc6"] Jul 21 06:19:50.946638 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:19:50.946609 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984533da_66c0_4ed2_b59c_7258adfb3890.slice/crio-fb05af02291abd89dc078643108a8cfd07103120b67f1a846e42a9fe187494a4 WatchSource:0}: Error finding container fb05af02291abd89dc078643108a8cfd07103120b67f1a846e42a9fe187494a4: Status 404 returned error can't find the container with id fb05af02291abd89dc078643108a8cfd07103120b67f1a846e42a9fe187494a4 Jul 21 06:19:51.657178 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:51.657143 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmpc6" event={"ID":"984533da-66c0-4ed2-b59c-7258adfb3890","Type":"ContainerStarted","Data":"fb05af02291abd89dc078643108a8cfd07103120b67f1a846e42a9fe187494a4"} Jul 21 06:19:52.663455 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:52.663414 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmpc6" event={"ID":"984533da-66c0-4ed2-b59c-7258adfb3890","Type":"ContainerStarted","Data":"613d23faea76f5ddd1511fa13685a32d0b47524b435241ef3a144aedd165f302"} Jul 21 06:19:52.663852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:52.663494 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vmpc6" event={"ID":"984533da-66c0-4ed2-b59c-7258adfb3890","Type":"ContainerStarted","Data":"584daf16e696f7571d3844888f248b447610fb796711cbd60f7c75ea1dcff65d"} Jul 21 06:19:52.679056 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:52.679012 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vmpc6" podStartSLOduration=129.695634054 podStartE2EDuration="2m10.678996334s" totalImagesPullingTime="983.36228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:52.67880346 +0000 UTC m=+131.259584666" watchObservedRunningTime="2026-07-21 06:19:52.678996334 +0000 UTC m=+131.259777525" Jul 21 06:19:52.764393 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:52.764360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:52.822410 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:52.822350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:19:53.668874 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:53.668842 2572 generic.go:356] "Generic (PLEG): container finished" podID="7fcd8546-0593-43c4-afe6-dfd5600fdde1" containerID="fde579335a8669d0360ece9962e6ca15c87143c74c578b4ddbe6508abefe9166" exitCode=0 Jul 21 06:19:53.669322 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:53.668922 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" event={"ID":"7fcd8546-0593-43c4-afe6-dfd5600fdde1","Type":"ContainerDied","Data":"fde579335a8669d0360ece9962e6ca15c87143c74c578b4ddbe6508abefe9166"} Jul 21 06:19:53.669362 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:53.669325 2572 scope.go:117] "RemoveContainer" containerID="fde579335a8669d0360ece9962e6ca15c87143c74c578b4ddbe6508abefe9166" Jul 21 06:19:54.674853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:54.674813 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-kxjsq" event={"ID":"7fcd8546-0593-43c4-afe6-dfd5600fdde1","Type":"ContainerStarted","Data":"4fd87b97f0d4aa52666c87529f233d196e7d56dd5522f71b11e812850919630a"} Jul 21 06:19:58.171498 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:19:58.171450 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" podUID="59bc2245-4ae7-4bff-98d9-91ee40f3974d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 06:20:08.171275 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:08.171236 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" podUID="59bc2245-4ae7-4bff-98d9-91ee40f3974d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 06:20:15.732539 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:15.732498 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:18.171275 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.171230 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" podUID="59bc2245-4ae7-4bff-98d9-91ee40f3974d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 06:20:18.171653 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.171314 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" Jul 21 06:20:18.171855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.171836 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"70a53fcdb8b26289d959dafe8696109b7b275f080f246e18bc3156e40a8d0664"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 21 06:20:18.171891 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.171876 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" podUID="59bc2245-4ae7-4bff-98d9-91ee40f3974d" containerName="service-proxy" containerID="cri-o://70a53fcdb8b26289d959dafe8696109b7b275f080f246e18bc3156e40a8d0664" gracePeriod=30 Jul 21 06:20:18.767564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.767532 2572 generic.go:356] "Generic (PLEG): container finished" podID="59bc2245-4ae7-4bff-98d9-91ee40f3974d" containerID="70a53fcdb8b26289d959dafe8696109b7b275f080f246e18bc3156e40a8d0664" exitCode=2 Jul 21 06:20:18.767735 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.767604 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerDied","Data":"70a53fcdb8b26289d959dafe8696109b7b275f080f246e18bc3156e40a8d0664"} Jul 21 06:20:18.767735 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:18.767646 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-98fc9cbc-w5zgs" event={"ID":"59bc2245-4ae7-4bff-98d9-91ee40f3974d","Type":"ContainerStarted","Data":"bb498f85522b424457ba0954dac068f14def5f7d3abe8d04b24200e37dcea011"} Jul 21 06:20:34.783525 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:34.783431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:34.830533 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:34.830491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:35.630903 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:35.630871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:35.685907 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:35.685868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:45.990923 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:45.990862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:46.085328 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:46.085294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:46.185876 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:46.185842 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:46.729411 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:46.729379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:46.779162 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:46.779094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:47.608103 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:47.608065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:47.657918 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:47.657889 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:56.647631 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:56.647597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:56.748305 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:56.748268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:56.796958 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:56.796920 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:57.250412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:57.250363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:58.449643 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:58.449607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:20:58.550743 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:20:58.550705 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:26.259101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:26.259055 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:26.358868 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:26.358828 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:46.446995 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:46.446963 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:46.501063 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:46.501035 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:55.550418 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:55.550375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:59.417614 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:59.417580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:21:59.513540 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:21:59.513497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:26.029436 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:26.029393 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:26.827001 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:26.826958 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:29.646915 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:29.646886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:29.746986 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:29.746951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:31.270265 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:31.270225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:31.378863 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:31.378820 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:31.473345 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:31.473306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:33.800745 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:33.800708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:34.027601 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:34.027566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:36.427248 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:36.427216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:36.479033 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:36.478989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:39.848410 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:39.848371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:39.953304 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:39.953266 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:41.001405 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.001366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:41.845225 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.845199 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:22:41.849051 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.849029 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:22:41.855818 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.855796 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 06:22:41.855967 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.855860 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:22:41.860260 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:41.860236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:22:45.698132 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:45.698080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:46.983211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:46.983175 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:22:47.696252 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:22:47.696221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:02.966649 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:02.966612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:03.067500 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:03.067465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:03.451628 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:03.451583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:03.547489 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:03.547460 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.049350 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.049308 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.241765 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.241727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.343457 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.343351 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.364245 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.364196 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r"] Jul 21 06:23:04.364838 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.364804 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" containerName="registry" Jul 21 06:23:04.364838 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.364833 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" containerName="registry" Jul 21 06:23:04.364984 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.364965 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75e39dc-9591-4a27-9309-a67e03a53767" containerName="registry" Jul 21 06:23:04.368758 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.368737 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.372320 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.372297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 06:23:04.372611 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.372593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 06:23:04.373334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.373319 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 06:23:04.373588 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.373572 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7pnhr\"" Jul 21 06:23:04.373676 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.373580 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 06:23:04.385256 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.385232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r"] Jul 21 06:23:04.459817 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.459781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.459817 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.459815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.460032 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.459842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.460032 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.459885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.460032 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.459917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsxds\" (UniqueName: \"kubernetes.io/projected/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-kube-api-access-hsxds\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.487981 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.487936 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.560634 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.560604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.560781 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.560639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.560781 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.560668 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.560781 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.560709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.560781 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.560730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsxds\" (UniqueName: \"kubernetes.io/projected/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-kube-api-access-hsxds\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.561180 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.561147 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.563101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.563078 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.563189 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.563100 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.563251 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.563235 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.572413 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.572387 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsxds\" (UniqueName: \"kubernetes.io/projected/5cf6e4fb-863c-4b4f-ad91-c97e33b31c38-kube-api-access-hsxds\") pod \"opendatahub-operator-controller-manager-78c844c949-hjg9r\" (UID: \"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.608659 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.608571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.678758 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.678727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:04.690497 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.690465 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.788580 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.788542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:04.813691 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.813669 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r"] Jul 21 06:23:04.815568 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:23:04.815540 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf6e4fb_863c_4b4f_ad91_c97e33b31c38.slice/crio-0cda073b88969ffa9ba0798f224d6ea867e17fc071659cd94ab5a8b2a6224166 WatchSource:0}: Error finding container 0cda073b88969ffa9ba0798f224d6ea867e17fc071659cd94ab5a8b2a6224166: Status 404 returned error can't find the container with id 0cda073b88969ffa9ba0798f224d6ea867e17fc071659cd94ab5a8b2a6224166 Jul 21 06:23:04.817306 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.817291 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 06:23:04.889510 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:04.889403 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:05.356926 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:05.356890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" event={"ID":"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38","Type":"ContainerStarted","Data":"0cda073b88969ffa9ba0798f224d6ea867e17fc071659cd94ab5a8b2a6224166"} Jul 21 06:23:08.371738 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:08.371704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" event={"ID":"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38","Type":"ContainerStarted","Data":"2c4403aac804e5123b07005291525a1ed71442da325faab1488fee2bafe93a72"} Jul 21 06:23:09.377129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:09.377027 2572 generic.go:356] "Generic (PLEG): container finished" podID="5cf6e4fb-863c-4b4f-ad91-c97e33b31c38" containerID="2c4403aac804e5123b07005291525a1ed71442da325faab1488fee2bafe93a72" exitCode=0 Jul 21 06:23:09.377129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:09.377091 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" event={"ID":"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38","Type":"ContainerDied","Data":"2c4403aac804e5123b07005291525a1ed71442da325faab1488fee2bafe93a72"} Jul 21 06:23:10.383619 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:10.383584 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" event={"ID":"5cf6e4fb-863c-4b4f-ad91-c97e33b31c38","Type":"ContainerStarted","Data":"aaf8b935672bda03231f59819a38f3743958958f2afc92e10f51f102aa29a21f"} Jul 21 06:23:10.384005 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:10.383721 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:10.409436 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:10.409376 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" podStartSLOduration=1.804536006 podStartE2EDuration="6.409360839s" totalImagesPullingTime="3.575656741s" totalInitContainerRuntime="1.029168092s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:10.407579189 +0000 UTC m=+328.988360381" watchObservedRunningTime="2026-07-21 06:23:10.409360839 +0000 UTC m=+328.990142033" Jul 21 06:23:11.914254 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:11.914214 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:12.024889 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:12.024852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:16.446998 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:16.446960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:16.572650 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:16.572610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:17.747577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:17.747538 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:17.847624 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:17.847588 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:19.822408 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:19.822336 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:21.390643 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:21.390612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-hjg9r" Jul 21 06:23:22.898469 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:22.898385 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.008086 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.008051 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.410959 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.410925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.472158 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.472130 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q"] Jul 21 06:23:23.485832 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.485810 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.488717 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.488678 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q"] Jul 21 06:23:23.490061 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.490033 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 21 06:23:23.490211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.490036 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 06:23:23.490211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.490094 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 06:23:23.490707 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.490685 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2sfdx\"" Jul 21 06:23:23.490818 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.490685 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 21 06:23:23.559631 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.559596 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.622813 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.622776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tmp\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.622979 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.622837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tls-certs\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.622979 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.622865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj8xl\" (UniqueName: \"kubernetes.io/projected/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-kube-api-access-tj8xl\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.679974 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.679883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.723791 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.723760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tmp\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.723955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.723809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tls-certs\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.723955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.723936 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj8xl\" (UniqueName: \"kubernetes.io/projected/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-kube-api-access-tj8xl\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.726203 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.726178 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tmp\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.726432 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.726412 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-tls-certs\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.739170 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.739104 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj8xl\" (UniqueName: \"kubernetes.io/projected/6f6215e1-a3f6-4a88-ad0c-55aeccde246e-kube-api-access-tj8xl\") pod \"kube-auth-proxy-5ff9c87565-m2n2q\" (UID: \"6f6215e1-a3f6-4a88-ad0c-55aeccde246e\") " pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.748956 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.748924 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.796627 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.796595 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" Jul 21 06:23:23.850044 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.849982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:23.931630 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:23.931602 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q"] Jul 21 06:23:23.933802 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:23:23.933775 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6215e1_a3f6_4a88_ad0c_55aeccde246e.slice/crio-21d8e3972d3525a46292ff1313ded9a8aee63373278da508c09720d83a4c65ba WatchSource:0}: Error finding container 21d8e3972d3525a46292ff1313ded9a8aee63373278da508c09720d83a4c65ba: Status 404 returned error can't find the container with id 21d8e3972d3525a46292ff1313ded9a8aee63373278da508c09720d83a4c65ba Jul 21 06:23:24.021542 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.021500 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:24.439918 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.439879 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" event={"ID":"6f6215e1-a3f6-4a88-ad0c-55aeccde246e","Type":"ContainerStarted","Data":"21d8e3972d3525a46292ff1313ded9a8aee63373278da508c09720d83a4c65ba"} Jul 21 06:23:24.605305 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.605271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:24.692605 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.692522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:24.753219 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.753157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:24.985482 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:24.985396 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:25.538757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:25.538660 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:27.453194 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:27.453164 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" event={"ID":"6f6215e1-a3f6-4a88-ad0c-55aeccde246e","Type":"ContainerStarted","Data":"c2017b446bb5b5e2e9b4946cc610533601d1c01387b1a8ed91e42d624d891f0d"} Jul 21 06:23:27.474345 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:27.470204 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5ff9c87565-m2n2q" podStartSLOduration=1.93402143 podStartE2EDuration="4.470182733s" totalImagesPullingTime="2.536161303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:27.468824576 +0000 UTC m=+346.049605770" watchObservedRunningTime="2026-07-21 06:23:27.470182733 +0000 UTC m=+346.050963928" Jul 21 06:23:29.389176 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:29.389133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:29.489006 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:29.488973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:29.920101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:29.920063 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:29.997866 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:29.997823 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:30.116973 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:30.116937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:31.180294 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.180266 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-tnn52"] Jul 21 06:23:31.183556 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.183537 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.186357 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.186334 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nms9n\"" Jul 21 06:23:31.187829 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.187810 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 06:23:31.187937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.187866 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 06:23:31.187937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.187924 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 06:23:31.188129 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.188092 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 06:23:31.188193 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.188139 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 06:23:31.193629 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.193608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-tnn52"] Jul 21 06:23:31.286343 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.286300 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b29ba0f1-0603-4a29-bf02-1f09a525f83c-manager-config\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.286343 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.286351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4zk\" (UniqueName: \"kubernetes.io/projected/b29ba0f1-0603-4a29-bf02-1f09a525f83c-kube-api-access-pf4zk\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.286564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.286377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.286564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.286451 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-metrics-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.387686 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.387647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4zk\" (UniqueName: \"kubernetes.io/projected/b29ba0f1-0603-4a29-bf02-1f09a525f83c-kube-api-access-pf4zk\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.387855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.387708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.387855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.387755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-metrics-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.387855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.387821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b29ba0f1-0603-4a29-bf02-1f09a525f83c-manager-config\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.388633 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.388556 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b29ba0f1-0603-4a29-bf02-1f09a525f83c-manager-config\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.390427 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.390407 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-metrics-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.390502 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.390473 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b29ba0f1-0603-4a29-bf02-1f09a525f83c-cert\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.397554 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.397529 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4zk\" (UniqueName: \"kubernetes.io/projected/b29ba0f1-0603-4a29-bf02-1f09a525f83c-kube-api-access-pf4zk\") pod \"lws-controller-manager-964495ff5-tnn52\" (UID: \"b29ba0f1-0603-4a29-bf02-1f09a525f83c\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.493502 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.493421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:31.631254 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:31.631224 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-tnn52"] Jul 21 06:23:31.634003 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:23:31.633966 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29ba0f1_0603_4a29_bf02_1f09a525f83c.slice/crio-7f1d2df998fc0f057d43f5c2d9c569445abcd85198dece4ba9734b3aabe5aa0b WatchSource:0}: Error finding container 7f1d2df998fc0f057d43f5c2d9c569445abcd85198dece4ba9734b3aabe5aa0b: Status 404 returned error can't find the container with id 7f1d2df998fc0f057d43f5c2d9c569445abcd85198dece4ba9734b3aabe5aa0b Jul 21 06:23:32.452361 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:32.452329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:32.474711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:32.474679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" event={"ID":"b29ba0f1-0603-4a29-bf02-1f09a525f83c","Type":"ContainerStarted","Data":"7f1d2df998fc0f057d43f5c2d9c569445abcd85198dece4ba9734b3aabe5aa0b"} Jul 21 06:23:33.561233 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:33.561144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:33.664995 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:33.664955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:33.828439 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:33.828351 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:34.001097 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.001050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:34.485130 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.485073 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" event={"ID":"b29ba0f1-0603-4a29-bf02-1f09a525f83c","Type":"ContainerStarted","Data":"102ed8b5416123f139b72c138c2fc099d08821bf20c4ccdcce6d679053132f74"} Jul 21 06:23:34.485314 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.485227 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:23:34.507074 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.507027 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" podStartSLOduration=0.832355812 podStartE2EDuration="3.507015334s" totalImagesPullingTime="2.674659522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:34.506837302 +0000 UTC m=+353.087618508" watchObservedRunningTime="2026-07-21 06:23:34.507015334 +0000 UTC m=+353.087796528" Jul 21 06:23:34.867057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.867010 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:34.959373 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:34.959324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:35.017725 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:35.017695 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:23:45.491681 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:23:45.491649 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-964495ff5-tnn52" Jul 21 06:24:10.910304 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:10.910263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:24.409256 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:24.409216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:24.475317 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:24.475277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:24.580684 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:24.580647 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:25.340525 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:25.340490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:25.550026 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:25.549993 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:49.488699 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:49.488662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:50.090330 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:50.090295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:52.984318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:52.984277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:54.908810 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:54.908769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:56.940000 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:56.939972 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:57.048989 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:57.048949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:57.901886 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:57.901849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:24:58.740339 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:24:58.740302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:00.703672 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:00.703637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:01.544027 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:01.543995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:03.747413 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:03.747326 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:03.805945 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:03.805904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:03.870480 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:03.870443 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:04.803714 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:04.803680 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:06.301496 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:06.301450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:06.403638 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:06.403609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:06.751843 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:06.751750 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:06.846285 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:06.846251 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:10.292148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:10.292093 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:10.350887 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:10.350854 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:14.116913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:14.116877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:14.224042 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:14.224005 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:14.303832 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:14.303799 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:14.480767 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:14.480657 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:17.635132 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:17.635087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:17.682835 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:17.682798 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:25.495054 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:25.495020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:25.595822 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:25.595787 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:25.876552 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:25.876520 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:25.977757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:25.977726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:28.455668 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:28.455637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:28.504372 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:28.504332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:33.656845 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:33.656800 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:33.757334 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:33.757292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:37.066437 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:37.066400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:37.129871 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:37.129829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:52.383015 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:52.382979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:25:52.480916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:25:52.480879 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:08.209290 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:08.209255 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:08.548890 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:08.548844 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:11.175140 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.175095 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:11.284471 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.284433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:11.334976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.334938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:11.554067 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.554031 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:26:11.557170 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.557153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.559769 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.559743 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 06:26:11.559868 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.559842 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 06:26:11.560043 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.560023 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 06:26:11.561240 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.561227 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jf2qz\"" Jul 21 06:26:11.565804 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.565776 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4j8w\" (UniqueName: \"kubernetes.io/projected/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-kube-api-access-q4j8w\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.565909 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.565860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-config-file\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.566246 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.566229 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:26:11.577403 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.577382 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:26:11.667210 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.667164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-config-file\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.667421 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.667249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4j8w\" (UniqueName: \"kubernetes.io/projected/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-kube-api-access-q4j8w\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.667806 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.667785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-config-file\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.675235 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.675214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4j8w\" (UniqueName: \"kubernetes.io/projected/1e28ad52-0398-4812-b6ea-6e7ba13ffae1-kube-api-access-q4j8w\") pod \"limitador-limitador-54d6d988d5-5fn7h\" (UID: \"1e28ad52-0398-4812-b6ea-6e7ba13ffae1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.866818 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.866730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:11.965727 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.965702 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:11.969150 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.969107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:11.971816 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.971781 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-86swx\"" Jul 21 06:26:11.976344 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:11.976319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:12.003340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.003308 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:26:12.003481 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.003436 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:12.005826 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:26:12.005797 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e28ad52_0398_4812_b6ea_6e7ba13ffae1.slice/crio-001980f6689cb58db4e898884f02f6f9a8d034e1d9628885c102676d0761d492 WatchSource:0}: Error finding container 001980f6689cb58db4e898884f02f6f9a8d034e1d9628885c102676d0761d492: Status 404 returned error can't find the container with id 001980f6689cb58db4e898884f02f6f9a8d034e1d9628885c102676d0761d492 Jul 21 06:26:12.070285 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.070247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htsp\" (UniqueName: \"kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp\") pod \"authorino-58cd955675-mdmff\" (UID: \"f77db596-146d-4612-9576-581da9174f2c\") " pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:12.101670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.101637 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:12.107862 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.107830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" event={"ID":"1e28ad52-0398-4812-b6ea-6e7ba13ffae1","Type":"ContainerStarted","Data":"001980f6689cb58db4e898884f02f6f9a8d034e1d9628885c102676d0761d492"} Jul 21 06:26:12.137207 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.137143 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:12.140365 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.140349 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:12.144547 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.144525 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:12.171343 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.171314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865bz\" (UniqueName: \"kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz\") pod \"authorino-75d556bd77-hd9kp\" (UID: \"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf\") " pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:12.171498 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.171349 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htsp\" (UniqueName: \"kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp\") pod \"authorino-58cd955675-mdmff\" (UID: \"f77db596-146d-4612-9576-581da9174f2c\") " pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:12.179250 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.179229 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htsp\" (UniqueName: \"kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp\") pod \"authorino-58cd955675-mdmff\" (UID: \"f77db596-146d-4612-9576-581da9174f2c\") " pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:12.272171 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.272134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865bz\" (UniqueName: \"kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz\") pod \"authorino-75d556bd77-hd9kp\" (UID: \"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf\") " pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:12.279967 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.279937 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-865bz\" (UniqueName: \"kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz\") pod \"authorino-75d556bd77-hd9kp\" (UID: \"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf\") " pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:12.280667 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.280649 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:12.406442 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.406358 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:12.409370 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:26:12.409340 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf77db596_146d_4612_9576_581da9174f2c.slice/crio-8402a12ba46b3971fc1c4742b5fce470674796d4abe414da01d924ccfc5fe140 WatchSource:0}: Error finding container 8402a12ba46b3971fc1c4742b5fce470674796d4abe414da01d924ccfc5fe140: Status 404 returned error can't find the container with id 8402a12ba46b3971fc1c4742b5fce470674796d4abe414da01d924ccfc5fe140 Jul 21 06:26:12.450046 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.449988 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:12.576842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:12.576819 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:12.579285 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:26:12.579251 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4b90afe_ff08_416a_ba5a_8fd9785e5cbf.slice/crio-9476b55a7ac7b07a02b51ab6bbfb17c670d33c3dfa8fe4c787f2e0519c4c0fe1 WatchSource:0}: Error finding container 9476b55a7ac7b07a02b51ab6bbfb17c670d33c3dfa8fe4c787f2e0519c4c0fe1: Status 404 returned error can't find the container with id 9476b55a7ac7b07a02b51ab6bbfb17c670d33c3dfa8fe4c787f2e0519c4c0fe1 Jul 21 06:26:13.115162 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:13.115089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mdmff" event={"ID":"f77db596-146d-4612-9576-581da9174f2c","Type":"ContainerStarted","Data":"8402a12ba46b3971fc1c4742b5fce470674796d4abe414da01d924ccfc5fe140"} Jul 21 06:26:13.116783 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:13.116739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9kp" event={"ID":"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf","Type":"ContainerStarted","Data":"9476b55a7ac7b07a02b51ab6bbfb17c670d33c3dfa8fe4c787f2e0519c4c0fe1"} Jul 21 06:26:18.150282 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.150240 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mdmff" event={"ID":"f77db596-146d-4612-9576-581da9174f2c","Type":"ContainerStarted","Data":"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0"} Jul 21 06:26:18.151772 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.151744 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9kp" event={"ID":"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf","Type":"ContainerStarted","Data":"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0"} Jul 21 06:26:18.153075 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.153050 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" event={"ID":"1e28ad52-0398-4812-b6ea-6e7ba13ffae1","Type":"ContainerStarted","Data":"08cf425ba2467835c61c1f183135c1a1f413ded2bf077ce4123bfc415fb01942"} Jul 21 06:26:18.153196 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.153184 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:18.166653 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.166614 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mdmff" podStartSLOduration=2.33326694 podStartE2EDuration="7.166602568s" totalImagesPullingTime="4.833335628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:18.165384454 +0000 UTC m=+516.746165653" watchObservedRunningTime="2026-07-21 06:26:18.166602568 +0000 UTC m=+516.747383762" Jul 21 06:26:18.180552 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.180489 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hd9kp" podStartSLOduration=1.551977025 podStartE2EDuration="6.180468825s" totalImagesPullingTime="4.6284918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:18.178361815 +0000 UTC m=+516.759143010" watchObservedRunningTime="2026-07-21 06:26:18.180468825 +0000 UTC m=+516.761250020" Jul 21 06:26:18.195020 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.194972 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" podStartSLOduration=1.945072839 podStartE2EDuration="7.194956766s" totalImagesPullingTime="5.249883927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:18.194179045 +0000 UTC m=+516.774960240" watchObservedRunningTime="2026-07-21 06:26:18.194956766 +0000 UTC m=+516.775737959" Jul 21 06:26:18.202326 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:18.202297 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:20.162480 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:20.162417 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mdmff" podUID="f77db596-146d-4612-9576-581da9174f2c" containerName="authorino" containerID="cri-o://6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0" gracePeriod=30 Jul 21 06:26:20.415529 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:20.415473 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:20.436540 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:20.436509 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8htsp\" (UniqueName: \"kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp\") pod \"f77db596-146d-4612-9576-581da9174f2c\" (UID: \"f77db596-146d-4612-9576-581da9174f2c\") " Jul 21 06:26:20.438890 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:20.438857 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp" (OuterVolumeSpecName: "kube-api-access-8htsp") pod "f77db596-146d-4612-9576-581da9174f2c" (UID: "f77db596-146d-4612-9576-581da9174f2c"). InnerVolumeSpecName "kube-api-access-8htsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:26:20.537850 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:20.537814 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8htsp\" (UniqueName: \"kubernetes.io/projected/f77db596-146d-4612-9576-581da9174f2c-kube-api-access-8htsp\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:26:21.167962 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.167926 2572 generic.go:356] "Generic (PLEG): container finished" podID="f77db596-146d-4612-9576-581da9174f2c" containerID="6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0" exitCode=0 Jul 21 06:26:21.167962 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.167962 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mdmff" Jul 21 06:26:21.168425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.168000 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mdmff" event={"ID":"f77db596-146d-4612-9576-581da9174f2c","Type":"ContainerDied","Data":"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0"} Jul 21 06:26:21.168425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.168035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mdmff" event={"ID":"f77db596-146d-4612-9576-581da9174f2c","Type":"ContainerDied","Data":"8402a12ba46b3971fc1c4742b5fce470674796d4abe414da01d924ccfc5fe140"} Jul 21 06:26:21.168425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.168050 2572 scope.go:117] "RemoveContainer" containerID="6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0" Jul 21 06:26:21.176007 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.175993 2572 scope.go:117] "RemoveContainer" containerID="6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0" Jul 21 06:26:21.176285 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:26:21.176267 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0\": container with ID starting with 6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0 not found: ID does not exist" containerID="6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0" Jul 21 06:26:21.176340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.176294 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0"} err="failed to get container status \"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0\": rpc error: code = NotFound desc = could not find container \"6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0\": container with ID starting with 6e4dfb49edd8babff1004c531218142ef39d19e54ac6f631fcee4c4e8cf873f0 not found: ID does not exist" Jul 21 06:26:21.188172 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.188150 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:21.193855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.193836 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mdmff"] Jul 21 06:26:21.965802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:21.962591 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f77db596-146d-4612-9576-581da9174f2c" path="/var/lib/kubelet/pods/f77db596-146d-4612-9576-581da9174f2c/volumes" Jul 21 06:26:29.161254 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:29.161225 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5fn7h" Jul 21 06:26:31.466497 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:31.466456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:31.565577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:31.565545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:31.978354 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:31.978311 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:43.415471 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:43.415431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:48.453164 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.453097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:48.616212 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.616157 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:48.716606 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.716534 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tssd7"] Jul 21 06:26:48.716840 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.716827 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77db596-146d-4612-9576-581da9174f2c" containerName="authorino" Jul 21 06:26:48.716884 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.716842 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77db596-146d-4612-9576-581da9174f2c" containerName="authorino" Jul 21 06:26:48.716917 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.716900 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f77db596-146d-4612-9576-581da9174f2c" containerName="authorino" Jul 21 06:26:48.724524 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.724500 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:48.725907 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.725886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tssd7"] Jul 21 06:26:48.860799 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.860744 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvnpp\" (UniqueName: \"kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp\") pod \"authorino-5d4b67c446-tssd7\" (UID: \"7d75dedd-7e75-4774-bd58-436a93df4281\") " pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:48.944988 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.944953 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tssd7"] Jul 21 06:26:48.945223 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:26:48.945200 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fvnpp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-tssd7" podUID="7d75dedd-7e75-4774-bd58-436a93df4281" Jul 21 06:26:48.961737 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.961708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvnpp\" (UniqueName: \"kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp\") pod \"authorino-5d4b67c446-tssd7\" (UID: \"7d75dedd-7e75-4774-bd58-436a93df4281\") " pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:48.967938 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.967872 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:26:48.970946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.970931 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:48.974018 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.973994 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 06:26:48.976978 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.976951 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvnpp\" (UniqueName: \"kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp\") pod \"authorino-5d4b67c446-tssd7\" (UID: \"7d75dedd-7e75-4774-bd58-436a93df4281\") " pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:48.978983 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:48.978956 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:26:49.062485 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.062445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.062690 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.062548 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmrl\" (UniqueName: \"kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.163858 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.163829 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.164028 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.163884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmrl\" (UniqueName: \"kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.166425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.166404 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.171451 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.171429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmrl\" (UniqueName: \"kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl\") pod \"authorino-75c4cbfd9-76dtq\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.288569 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.288530 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:26:49.289476 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.289451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:49.297144 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.297105 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:49.364849 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.364821 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvnpp\" (UniqueName: \"kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp\") pod \"7d75dedd-7e75-4774-bd58-436a93df4281\" (UID: \"7d75dedd-7e75-4774-bd58-436a93df4281\") " Jul 21 06:26:49.367070 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.367041 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp" (OuterVolumeSpecName: "kube-api-access-fvnpp") pod "7d75dedd-7e75-4774-bd58-436a93df4281" (UID: "7d75dedd-7e75-4774-bd58-436a93df4281"). InnerVolumeSpecName "kube-api-access-fvnpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:26:49.418542 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.418516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:26:49.421217 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:26:49.421186 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2edc066_d2fa_4bcd_a570_e6cee44dad8d.slice/crio-e859bfb898ff0f57ae6b8770d4392a58e2b3964e07c7baa821d3d705285b4781 WatchSource:0}: Error finding container e859bfb898ff0f57ae6b8770d4392a58e2b3964e07c7baa821d3d705285b4781: Status 404 returned error can't find the container with id e859bfb898ff0f57ae6b8770d4392a58e2b3964e07c7baa821d3d705285b4781 Jul 21 06:26:49.465931 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:49.465901 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvnpp\" (UniqueName: \"kubernetes.io/projected/7d75dedd-7e75-4774-bd58-436a93df4281-kube-api-access-fvnpp\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:26:50.294309 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.294279 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tssd7" Jul 21 06:26:50.294309 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.294301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" event={"ID":"f2edc066-d2fa-4bcd-a570-e6cee44dad8d","Type":"ContainerStarted","Data":"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5"} Jul 21 06:26:50.294560 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.294344 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" event={"ID":"f2edc066-d2fa-4bcd-a570-e6cee44dad8d","Type":"ContainerStarted","Data":"e859bfb898ff0f57ae6b8770d4392a58e2b3964e07c7baa821d3d705285b4781"} Jul 21 06:26:50.312130 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.312079 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" podStartSLOduration=1.905690785 podStartE2EDuration="2.312063573s" totalImagesPullingTime="406.372788ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:50.311289813 +0000 UTC m=+548.892071008" watchObservedRunningTime="2026-07-21 06:26:50.312063573 +0000 UTC m=+548.892844766" Jul 21 06:26:50.333683 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.333648 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tssd7"] Jul 21 06:26:50.338970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.338942 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:50.339216 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.339158 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hd9kp" podUID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" containerName="authorino" containerID="cri-o://3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0" gracePeriod=30 Jul 21 06:26:50.341251 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.341230 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tssd7"] Jul 21 06:26:50.592595 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.592568 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:50.676650 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.676619 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-865bz\" (UniqueName: \"kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz\") pod \"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf\" (UID: \"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf\") " Jul 21 06:26:50.678775 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.678748 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz" (OuterVolumeSpecName: "kube-api-access-865bz") pod "a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" (UID: "a4b90afe-ff08-416a-ba5a-8fd9785e5cbf"). InnerVolumeSpecName "kube-api-access-865bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:26:50.778076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:50.778040 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-865bz\" (UniqueName: \"kubernetes.io/projected/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf-kube-api-access-865bz\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:26:51.208035 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.208001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:51.300099 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.300063 2572 generic.go:356] "Generic (PLEG): container finished" podID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" containerID="3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0" exitCode=0 Jul 21 06:26:51.300318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.300107 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9kp" Jul 21 06:26:51.300318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.300161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9kp" event={"ID":"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf","Type":"ContainerDied","Data":"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0"} Jul 21 06:26:51.300318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.300212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9kp" event={"ID":"a4b90afe-ff08-416a-ba5a-8fd9785e5cbf","Type":"ContainerDied","Data":"9476b55a7ac7b07a02b51ab6bbfb17c670d33c3dfa8fe4c787f2e0519c4c0fe1"} Jul 21 06:26:51.300318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.300234 2572 scope.go:117] "RemoveContainer" containerID="3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0" Jul 21 06:26:51.309278 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.309263 2572 scope.go:117] "RemoveContainer" containerID="3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0" Jul 21 06:26:51.309513 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:26:51.309494 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0\": container with ID starting with 3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0 not found: ID does not exist" containerID="3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0" Jul 21 06:26:51.309572 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.309524 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0"} err="failed to get container status \"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0\": rpc error: code = NotFound desc = could not find container \"3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0\": container with ID starting with 3495d875a4eff92f5ef132dd4ec7a511dbd216bc2636a0117e9ba53b2ebb44d0 not found: ID does not exist" Jul 21 06:26:51.321073 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.321046 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:51.322783 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.322741 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9kp"] Jul 21 06:26:51.961474 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.961440 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d75dedd-7e75-4774-bd58-436a93df4281" path="/var/lib/kubelet/pods/7d75dedd-7e75-4774-bd58-436a93df4281/volumes" Jul 21 06:26:51.961848 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:51.961662 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" path="/var/lib/kubelet/pods/a4b90afe-ff08-416a-ba5a-8fd9785e5cbf/volumes" Jul 21 06:26:55.073876 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:55.073843 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:55.166644 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:55.166606 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:55.225333 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:55.225300 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:55.639325 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:55.639291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:58.779671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:58.779628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:26:58.878084 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:26:58.878045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:07.569326 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:07.569285 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:29.886843 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:29.886811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:29.984931 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:29.984884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:30.637876 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:30.637846 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:30.806354 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:30.806319 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:31.203362 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:31.203329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:31.321523 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:31.321491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:31.409332 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:31.409301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:27:40.396135 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:40.396056 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:40.493237 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:40.493202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:41.874340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:41.874311 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:27:41.884150 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:41.884099 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:27:41.888983 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:41.888955 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:27:41.892491 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:41.892475 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:27:48.985025 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:48.984990 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:49.299442 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:49.299407 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:27:57.505606 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:57.505574 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:27:58.490064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:27:58.490027 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:28:01.822276 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:01.822237 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:28:02.992412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:02.992374 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:28:17.188252 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:17.188215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:28:18.281959 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:18.281922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:28:19.792638 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:19.792602 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:28:35.590955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.590924 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh"] Jul 21 06:28:35.591428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.591264 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" containerName="authorino" Jul 21 06:28:35.591428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.591279 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" containerName="authorino" Jul 21 06:28:35.591428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.591368 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b90afe-ff08-416a-ba5a-8fd9785e5cbf" containerName="authorino" Jul 21 06:28:35.594156 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.594141 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.597208 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.597190 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 06:28:35.598626 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.598607 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 06:28:35.598680 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.598635 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 21 06:28:35.598953 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.598933 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r52vr\"" Jul 21 06:28:35.605152 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.605133 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh"] Jul 21 06:28:35.605987 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.605968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e252f8a9-7604-42c6-adca-77711c884615-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.606090 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.606014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.606090 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.606049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.606226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.606107 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.606226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.606155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdh5\" (UniqueName: \"kubernetes.io/projected/e252f8a9-7604-42c6-adca-77711c884615-kube-api-access-zfdh5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.606226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.606184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.628165 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.628136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:28:35.707037 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.706999 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707037 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdh5\" (UniqueName: \"kubernetes.io/projected/e252f8a9-7604-42c6-adca-77711c884615-kube-api-access-zfdh5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707319 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707068 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707319 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e252f8a9-7604-42c6-adca-77711c884615-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707319 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707182 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707319 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707213 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707530 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707554 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.707667 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.707596 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.709596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.709571 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e252f8a9-7604-42c6-adca-77711c884615-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.709707 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.709691 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e252f8a9-7604-42c6-adca-77711c884615-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.715723 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.715697 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdh5\" (UniqueName: \"kubernetes.io/projected/e252f8a9-7604-42c6-adca-77711c884615-kube-api-access-zfdh5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fz6dh\" (UID: \"e252f8a9-7604-42c6-adca-77711c884615\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:35.903708 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:35.903609 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:36.036063 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:36.036037 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh"] Jul 21 06:28:36.038059 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:28:36.038029 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode252f8a9_7604_42c6_adca_77711c884615.slice/crio-fef878afd0c5ff8caea777152a3190fd22976d416dac1ebf8f3a62d9c9af42d5 WatchSource:0}: Error finding container fef878afd0c5ff8caea777152a3190fd22976d416dac1ebf8f3a62d9c9af42d5: Status 404 returned error can't find the container with id fef878afd0c5ff8caea777152a3190fd22976d416dac1ebf8f3a62d9c9af42d5 Jul 21 06:28:36.039256 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:36.039240 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 06:28:36.738284 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:36.738243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" event={"ID":"e252f8a9-7604-42c6-adca-77711c884615","Type":"ContainerStarted","Data":"fef878afd0c5ff8caea777152a3190fd22976d416dac1ebf8f3a62d9c9af42d5"} Jul 21 06:28:37.745073 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:37.745040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" event={"ID":"e252f8a9-7604-42c6-adca-77711c884615","Type":"ContainerStarted","Data":"43780f469fd9f3b0a5ae92636e599c72d5c56744d8fe9e6081a7e257d8e60a7a"} Jul 21 06:28:37.766273 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:37.766225 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" podStartSLOduration=1.63670206 podStartE2EDuration="2.766209852s" totalImagesPullingTime="1.129507792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:28:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:28:37.764806861 +0000 UTC m=+656.345588056" watchObservedRunningTime="2026-07-21 06:28:37.766209852 +0000 UTC m=+656.346991046" Jul 21 06:28:38.303273 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:38.303239 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:28:45.904732 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:45.904689 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:45.905145 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:45.904764 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:45.917412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:45.917385 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:46.700967 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.700938 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8"] Jul 21 06:28:46.704363 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.704343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.707970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.707952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 21 06:28:46.714211 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.714191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8"] Jul 21 06:28:46.725412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.725378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:28:46.796777 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.796751 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fz6dh" Jul 21 06:28:46.807336 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.807475 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjrgj\" (UniqueName: \"kubernetes.io/projected/4e4e8844-1fdd-411e-942f-8ecfe325f435-kube-api-access-tjrgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.807475 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807422 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.807564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807472 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.807564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.807626 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.807593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4e8844-1fdd-411e-942f-8ecfe325f435-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.908659 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4e8844-1fdd-411e-942f-8ecfe325f435-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjrgj\" (UniqueName: \"kubernetes.io/projected/4e4e8844-1fdd-411e-942f-8ecfe325f435-kube-api-access-tjrgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908761 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.908792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.909261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.909321 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.909449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.909374 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.911202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.911180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e4e8844-1fdd-411e-942f-8ecfe325f435-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.911345 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.911328 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e4e8844-1fdd-411e-942f-8ecfe325f435-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:46.918854 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:46.918826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjrgj\" (UniqueName: \"kubernetes.io/projected/4e4e8844-1fdd-411e-942f-8ecfe325f435-kube-api-access-tjrgj\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8\" (UID: \"4e4e8844-1fdd-411e-942f-8ecfe325f435\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:47.013648 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:47.013621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:47.152618 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:47.152595 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8"] Jul 21 06:28:47.154816 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:28:47.154792 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e4e8844_1fdd_411e_942f_8ecfe325f435.slice/crio-7e0b2bd3efa3815e3225c85a67902f50befeb67515e630411ca666ee7d3b44f7 WatchSource:0}: Error finding container 7e0b2bd3efa3815e3225c85a67902f50befeb67515e630411ca666ee7d3b44f7: Status 404 returned error can't find the container with id 7e0b2bd3efa3815e3225c85a67902f50befeb67515e630411ca666ee7d3b44f7 Jul 21 06:28:47.790701 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:47.790673 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" event={"ID":"4e4e8844-1fdd-411e-942f-8ecfe325f435","Type":"ContainerStarted","Data":"09f8ac2479ab82cf2f59c58f54b7b24fe636997d629b0e82a9ec33648d5c101d"} Jul 21 06:28:47.790701 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:47.790711 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" event={"ID":"4e4e8844-1fdd-411e-942f-8ecfe325f435","Type":"ContainerStarted","Data":"7e0b2bd3efa3815e3225c85a67902f50befeb67515e630411ca666ee7d3b44f7"} Jul 21 06:28:47.807847 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:47.807799 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" podStartSLOduration=1.610339856 podStartE2EDuration="1.807783649s" totalImagesPullingTime="197.443793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:28:47.807228394 +0000 UTC m=+666.388009589" watchObservedRunningTime="2026-07-21 06:28:47.807783649 +0000 UTC m=+666.388564843" Jul 21 06:28:50.402567 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:50.402532 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:28:57.014049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:57.014013 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:57.014519 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:57.014093 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:57.026427 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:57.026402 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:28:57.844852 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:28:57.844826 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8" Jul 21 06:29:21.678327 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:21.678292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:25.212418 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:25.212381 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:41.466155 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.466068 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74f6ddbb8d-zndvf"] Jul 21 06:29:41.469307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.469290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.477828 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.477803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74f6ddbb8d-zndvf"] Jul 21 06:29:41.555460 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.555421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/092a4d05-337e-4ad4-a87b-2852c0cf12f8-tls-cert\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.555643 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.555473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshpt\" (UniqueName: \"kubernetes.io/projected/092a4d05-337e-4ad4-a87b-2852c0cf12f8-kube-api-access-lshpt\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.656763 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.656724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/092a4d05-337e-4ad4-a87b-2852c0cf12f8-tls-cert\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.656936 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.656772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshpt\" (UniqueName: \"kubernetes.io/projected/092a4d05-337e-4ad4-a87b-2852c0cf12f8-kube-api-access-lshpt\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.659382 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.659359 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/092a4d05-337e-4ad4-a87b-2852c0cf12f8-tls-cert\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.664815 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.664787 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshpt\" (UniqueName: \"kubernetes.io/projected/092a4d05-337e-4ad4-a87b-2852c0cf12f8-kube-api-access-lshpt\") pod \"authorino-74f6ddbb8d-zndvf\" (UID: \"092a4d05-337e-4ad4-a87b-2852c0cf12f8\") " pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.779064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.779034 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" Jul 21 06:29:41.914204 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.914181 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74f6ddbb8d-zndvf"] Jul 21 06:29:41.916312 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:29:41.916270 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod092a4d05_337e_4ad4_a87b_2852c0cf12f8.slice/crio-c9864ee2212ee593658312ae2e5872665ec9fac61c0a06d5ecc1fa2db82fe650 WatchSource:0}: Error finding container c9864ee2212ee593658312ae2e5872665ec9fac61c0a06d5ecc1fa2db82fe650: Status 404 returned error can't find the container with id c9864ee2212ee593658312ae2e5872665ec9fac61c0a06d5ecc1fa2db82fe650 Jul 21 06:29:41.944353 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:41.944321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:42.012774 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:42.012741 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" event={"ID":"092a4d05-337e-4ad4-a87b-2852c0cf12f8","Type":"ContainerStarted","Data":"c9864ee2212ee593658312ae2e5872665ec9fac61c0a06d5ecc1fa2db82fe650"} Jul 21 06:29:42.046138 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:42.046040 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:43.020895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.020860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" event={"ID":"092a4d05-337e-4ad4-a87b-2852c0cf12f8","Type":"ContainerStarted","Data":"9b240ce5deeef79410b3fd1bb012e27781cc0625fc3503147ac6b2dae6d6bd72"} Jul 21 06:29:43.037701 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.037650 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74f6ddbb8d-zndvf" podStartSLOduration=1.6693177399999999 podStartE2EDuration="2.037634483s" totalImagesPullingTime="368.316743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:29:43.037168768 +0000 UTC m=+721.617949963" watchObservedRunningTime="2026-07-21 06:29:43.037634483 +0000 UTC m=+721.618415691" Jul 21 06:29:43.075802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.075768 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:29:43.076027 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.075997 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" podUID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" containerName="authorino" containerID="cri-o://08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5" gracePeriod=30 Jul 21 06:29:43.151830 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.151793 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:43.235570 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.235537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:29:43.326296 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.326268 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:29:43.371865 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.371832 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert\") pod \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " Jul 21 06:29:43.372048 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.371918 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhmrl\" (UniqueName: \"kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl\") pod \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\" (UID: \"f2edc066-d2fa-4bcd-a570-e6cee44dad8d\") " Jul 21 06:29:43.374169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.374140 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl" (OuterVolumeSpecName: "kube-api-access-jhmrl") pod "f2edc066-d2fa-4bcd-a570-e6cee44dad8d" (UID: "f2edc066-d2fa-4bcd-a570-e6cee44dad8d"). InnerVolumeSpecName "kube-api-access-jhmrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:29:43.381865 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.381841 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f2edc066-d2fa-4bcd-a570-e6cee44dad8d" (UID: "f2edc066-d2fa-4bcd-a570-e6cee44dad8d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:29:43.472477 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.472441 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhmrl\" (UniqueName: \"kubernetes.io/projected/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-kube-api-access-jhmrl\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:29:43.472477 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:43.472470 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f2edc066-d2fa-4bcd-a570-e6cee44dad8d-tls-cert\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:29:44.026790 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.026751 2572 generic.go:356] "Generic (PLEG): container finished" podID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" containerID="08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5" exitCode=0 Jul 21 06:29:44.027299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.026799 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" Jul 21 06:29:44.027299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.026830 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" event={"ID":"f2edc066-d2fa-4bcd-a570-e6cee44dad8d","Type":"ContainerDied","Data":"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5"} Jul 21 06:29:44.027299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.026867 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75c4cbfd9-76dtq" event={"ID":"f2edc066-d2fa-4bcd-a570-e6cee44dad8d","Type":"ContainerDied","Data":"e859bfb898ff0f57ae6b8770d4392a58e2b3964e07c7baa821d3d705285b4781"} Jul 21 06:29:44.027299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.026883 2572 scope.go:117] "RemoveContainer" containerID="08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5" Jul 21 06:29:44.035259 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.035242 2572 scope.go:117] "RemoveContainer" containerID="08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5" Jul 21 06:29:44.035513 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:29:44.035488 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5\": container with ID starting with 08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5 not found: ID does not exist" containerID="08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5" Jul 21 06:29:44.035570 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.035522 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5"} err="failed to get container status \"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5\": rpc error: code = NotFound desc = could not find container \"08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5\": container with ID starting with 08ada917a593949df9d5f6b81f0933de407f9d0abbba25fceef2862586bc45a5 not found: ID does not exist" Jul 21 06:29:44.043007 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.042979 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:29:44.046873 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:44.046853 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75c4cbfd9-76dtq"] Jul 21 06:29:45.961262 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:29:45.961226 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" path="/var/lib/kubelet/pods/f2edc066-d2fa-4bcd-a570-e6cee44dad8d/volumes" Jul 21 06:30:11.690506 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:30:11.690473 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:30:21.784341 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:30:21.784307 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:30:32.588718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:30:32.588683 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:31:18.929031 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:31:18.928945 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:31:48.036930 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:31:48.036894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:31:49.300419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:31:49.300380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:15.793406 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:15.793369 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:32:21.950639 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:21.950599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:22.051373 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:22.051303 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:22.189162 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:22.189087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:27.847666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:27.847633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:27.955420 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:27.955382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:28.049246 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:28.049210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:28.219819 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:28.219740 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:33.716996 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:33.716899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:33.819147 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:33.819103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:32:41.907132 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:41.907095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:32:41.910770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:41.910746 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:32:41.916136 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:41.916102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:32:41.919430 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:41.919411 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:32:51.389684 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:32:51.389654 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:00.891564 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:00.891528 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:09.590760 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:09.590716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:18.888091 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:18.888059 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:28.993671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:28.993637 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:38.395684 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:38.395643 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:49.989382 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:49.989343 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:33:50.519025 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:50.518986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:33:51.654509 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:51.654480 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:33:59.395575 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:33:59.395534 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:34:25.188765 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:34:25.188683 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:34:37.396399 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:34:37.396364 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:00.794249 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:00.794212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:11.197125 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:11.197082 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:26.591720 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:26.591680 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:36.998933 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:36.998845 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:46.587392 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:46.587357 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:55.889060 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:55.889018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:35:58.857038 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:58.856998 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:35:58.949079 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:35:58.949041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:36:04.495921 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:36:04.495880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:36:07.717002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:36:07.716970 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:37:03.495214 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:03.495138 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:37:41.933361 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:41.933329 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:37:41.936827 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:41.936796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:37:41.939448 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:41.939410 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:37:41.942911 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:41.942893 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:37:54.992829 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:37:54.992785 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:03.691813 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:03.691774 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:16.284527 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:16.284493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:27.195894 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:27.195858 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:38.490537 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:38.490451 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:49.293973 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:49.293932 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:38:58.090574 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:38:58.090537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:39:09.286682 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:39:09.286644 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:39:20.995546 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:39:20.995511 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:39:29.691478 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:39:29.691436 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:39:40.390695 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:39:40.390652 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:40:02.386295 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:02.386260 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:40:11.784412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:11.784331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:40:12.796047 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.796015 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:40:12.796539 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.796518 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" containerName="authorino" Jul 21 06:40:12.796612 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.796542 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" containerName="authorino" Jul 21 06:40:12.796666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.796638 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2edc066-d2fa-4bcd-a570-e6cee44dad8d" containerName="authorino" Jul 21 06:40:12.799515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.799490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.802318 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.802295 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-104f0ea1-kserve-self-signed-certs\"" Jul 21 06:40:12.813904 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.813872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:40:12.857718 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.857676 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:40:12.875908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.875867 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.875908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.875907 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.876101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.875925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.876101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.875948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.876101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.876051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.876101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.876092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977463 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977417 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977463 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977599 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.977711 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977693 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.978009 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977979 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.978009 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.977988 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.978009 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.978006 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.979839 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.979813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.980264 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.980243 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:12.986059 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:12.986036 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt\") pod \"e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:13.109921 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:13.109817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:13.247306 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:13.247240 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:40:13.249557 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:40:13.249525 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c97eea0_6f6b_4713_818b_46025c0c1bb0.slice/crio-6b7fa282f93a9cbc36450c656d30f06e38fa05eb7b2bfb4bf731df761cc6ac5a WatchSource:0}: Error finding container 6b7fa282f93a9cbc36450c656d30f06e38fa05eb7b2bfb4bf731df761cc6ac5a: Status 404 returned error can't find the container with id 6b7fa282f93a9cbc36450c656d30f06e38fa05eb7b2bfb4bf731df761cc6ac5a Jul 21 06:40:13.704797 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:13.704762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" event={"ID":"4c97eea0-6f6b-4713-818b-46025c0c1bb0","Type":"ContainerStarted","Data":"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5"} Jul 21 06:40:13.704976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:13.704805 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" event={"ID":"4c97eea0-6f6b-4713-818b-46025c0c1bb0","Type":"ContainerStarted","Data":"6b7fa282f93a9cbc36450c656d30f06e38fa05eb7b2bfb4bf731df761cc6ac5a"} Jul 21 06:40:13.723124 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:13.723057 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" podStartSLOduration=1.723039623 podStartE2EDuration="1.723039623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:40:13.721775715 +0000 UTC m=+1352.302556975" watchObservedRunningTime="2026-07-21 06:40:13.723039623 +0000 UTC m=+1352.303820816" Jul 21 06:40:23.110359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:23.110253 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:23.110359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:23.110319 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:23.123058 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:23.123032 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:23.760489 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:23.760456 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:40:24.890626 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:24.890590 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:40:32.412939 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:32.412901 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:40:36.997155 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:36.997103 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:40:53.026665 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:53.026632 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:40:53.049518 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:53.049490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:40:54.411959 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:54.411925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:40:56.799910 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:40:56.799878 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:41:08.047411 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.047366 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" podUID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" containerName="main" containerID="cri-o://05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5" gracePeriod=45 Jul 21 06:41:08.295634 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.295604 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:41:08.451307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451218 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451260 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451290 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451325 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451460 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451532 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs\") pod \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\" (UID: \"4c97eea0-6f6b-4713-818b-46025c0c1bb0\") " Jul 21 06:41:08.451596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451574 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache" (OuterVolumeSpecName: "model-cache") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:41:08.451796 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451603 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home" (OuterVolumeSpecName: "home") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:41:08.451796 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451743 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:41:08.451905 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451850 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.451905 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451865 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.451905 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.451880 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.453757 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.453719 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt" (OuterVolumeSpecName: "kube-api-access-jjzwt") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "kube-api-access-jjzwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:41:08.453902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.453885 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm" (OuterVolumeSpecName: "dshm") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:41:08.454165 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.454135 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4c97eea0-6f6b-4713-818b-46025c0c1bb0" (UID: "4c97eea0-6f6b-4713-818b-46025c0c1bb0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:41:08.552340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.552301 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjzwt\" (UniqueName: \"kubernetes.io/projected/4c97eea0-6f6b-4713-818b-46025c0c1bb0-kube-api-access-jjzwt\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.552340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.552333 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c97eea0-6f6b-4713-818b-46025c0c1bb0-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.552340 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.552343 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c97eea0-6f6b-4713-818b-46025c0c1bb0-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:41:08.946540 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.946501 2572 generic.go:356] "Generic (PLEG): container finished" podID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" containerID="05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5" exitCode=0 Jul 21 06:41:08.946749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.946574 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" Jul 21 06:41:08.946749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.946593 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" event={"ID":"4c97eea0-6f6b-4713-818b-46025c0c1bb0","Type":"ContainerDied","Data":"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5"} Jul 21 06:41:08.946749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.946645 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj" event={"ID":"4c97eea0-6f6b-4713-818b-46025c0c1bb0","Type":"ContainerDied","Data":"6b7fa282f93a9cbc36450c656d30f06e38fa05eb7b2bfb4bf731df761cc6ac5a"} Jul 21 06:41:08.946749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.946670 2572 scope.go:117] "RemoveContainer" containerID="05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5" Jul 21 06:41:08.961759 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.961740 2572 scope.go:117] "RemoveContainer" containerID="05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5" Jul 21 06:41:08.962083 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:41:08.962064 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5\": container with ID starting with 05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5 not found: ID does not exist" containerID="05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5" Jul 21 06:41:08.962151 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.962093 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5"} err="failed to get container status \"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5\": rpc error: code = NotFound desc = could not find container \"05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5\": container with ID starting with 05f5d7edaef6f4fb427231f3da979a5f347ef85e4c2cc733e0f5d999de2689f5 not found: ID does not exist" Jul 21 06:41:08.972179 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.972156 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:41:08.975759 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:08.975739 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-104f0ea1-kserve-6d45dd57b7-2kpcj"] Jul 21 06:41:09.962222 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:09.962183 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" path="/var/lib/kubelet/pods/4c97eea0-6f6b-4713-818b-46025c0c1bb0/volumes" Jul 21 06:41:10.591228 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:10.591195 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:41:19.691409 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:19.691372 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:41:31.093298 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:31.093255 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:41:41.193686 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:41.193607 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:41:50.993949 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:41:50.993914 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:01.193226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:01.193194 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:10.590637 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:10.590598 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:18.693025 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:18.692989 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:32.792939 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:32.792896 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:41.596651 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:41.596610 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:42:41.969704 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:41.969616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:42:41.972391 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:41.972364 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:42:41.973458 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:41.973437 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:42:41.976038 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:41.976020 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:42:51.401137 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:42:51.400706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:03.787444 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:03.787357 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:12.986864 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:12.986834 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:23.195036 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:23.194990 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:34.797681 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:34.797647 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:38.320008 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:38.319969 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:43:38.414634 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:38.414598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:43:46.318063 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:46.318017 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:43:59.587475 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:43:59.587441 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:44:04.956671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:04.956639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:05.059839 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:05.059806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:05.411765 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:05.411731 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:11.026154 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:11.026072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:11.128355 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:11.128320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:11.272933 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:11.272902 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:11.586557 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:11.586499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:11.832765 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:11.832719 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:13.519490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:13.519459 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:13.613902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:13.613866 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:13.714077 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:13.714045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:14.093560 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:14.093528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:14.192476 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:14.192448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:14.309560 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:14.309490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:18.589480 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:18.589447 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:44:34.571172 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:34.571055 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:49.726819 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:49.726783 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:52.272403 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:52.272369 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:52.401854 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:52.401814 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:52.591392 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:52.591303 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:44:54.413080 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:54.413039 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:54.618978 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:54.618942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:55.099999 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:55.099968 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:55.414186 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:55.414070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:55.513671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:55.513641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:55.644559 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:55.644525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:56.064558 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:56.064526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:56.143978 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:56.143947 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:58.920282 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:58.920231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:59.168556 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:59.168519 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:59.604283 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:59.604257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:59.713851 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:59.713818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:44:59.809087 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:44:59.809050 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:02.004598 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:02.004562 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:45:34.548063 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:34.548032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:37.400947 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:37.400911 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:45:39.247686 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:39.247652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:39.328230 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:39.328192 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:39.537596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:39.537566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:39.801148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:39.801041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:40.179452 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:40.179375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:40.438681 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:40.438597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:42.115982 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:42.115950 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:42.213974 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:42.213941 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:42.339664 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:42.339633 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:42.817428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:42.817393 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:42.924844 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:42.924807 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:43.080644 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:43.080557 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:45:48.795490 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:45:48.795453 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:46:18.414076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:18.413991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:20.999750 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:20.999700 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:46:23.062546 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:23.062504 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:24.318090 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:24.318057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:24.538236 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:24.538202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:24.771912 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:24.771883 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:25.111282 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:25.111195 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:25.261949 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:25.261917 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:27.331386 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:27.331355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:27.434064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:27.434031 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:27.513498 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:27.513467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:27.735804 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:27.735727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:28.216149 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:28.216096 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:28.320462 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:28.320428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:46:33.096528 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:46:33.096497 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:47:02.758225 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:02.758187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:05.688749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:05.688715 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:47:07.316033 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:07.315997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:07.483232 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:07.483202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:08.334864 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:08.334829 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:08.437999 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:08.437966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:09.879256 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:09.879220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:12.486990 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:12.486953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:12.587988 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:12.587956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:15.647804 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:15.647772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:15.838692 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:15.838658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:15.930749 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:15.930663 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:16.458708 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:16.458664 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:41.996409 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:41.996378 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:47:41.996886 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:41.996743 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:47:41.999860 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:41.999839 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:47:42.000175 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:42.000154 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:47:42.676768 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:42.676737 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:48.547924 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:48.547894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:48.657640 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:48.657587 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:47:48.751335 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:47:48.751291 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:04.956359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:04.956305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:10.787887 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:10.787803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:10.887515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:10.887471 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:21.274763 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:21.274726 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:22.158892 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:22.158860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:28.939418 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:28.939370 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:29.052003 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:29.051948 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:29.145406 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:29.145353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:29.247708 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:29.247610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:30.088101 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:30.088062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:30.194895 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:30.194859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:30.288329 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:30.288299 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:32.101108 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:32.101069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:33.193761 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:33.193728 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:48:37.895970 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:37.895932 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:37.996067 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:37.996027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:39.059790 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:39.059755 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:42.692849 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:42.692810 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:48:44.875167 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:44.875104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:44.977931 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:44.977885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:45.144025 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:45.143934 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:45.488955 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:45.488861 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:45.982975 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:45.982938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.015812 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.015769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.112544 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.112502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.255843 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.255805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.357907 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.357796 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.685697 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.685616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:49.786762 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:49.786729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:53.442091 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:53.442058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:54.129592 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:54.129559 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:54.276355 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:54.276324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:54.594452 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:54.594417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:48:55.904904 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:48:55.904875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:49:00.371447 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:00.371416 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:00.445905 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:00.445848 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:11.412509 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:11.412418 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:14.112307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:14.112272 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:49:15.901345 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:15.901306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:16.348812 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:16.348771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.057285 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.057248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.150057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.150019 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.324345 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.324260 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.556968 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.556927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.709712 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.709607 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.807770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.807738 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:22.954884 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:22.954847 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:29.233074 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:29.233006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:29.361755 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:29.361717 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:29.591128 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:29.591090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:29.691798 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:29.691770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:35.461268 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:35.461231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:35.550167 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:35.550134 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:44.490901 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:44.490862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:44.845670 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:44.845631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:45.064395 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:45.064360 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:48.397140 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:48.397088 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:48.510667 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:48.510635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:48.599308 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:48.599276 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:49.134376 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:49.134339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:49.243009 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:49.242982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:52.728631 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:52.728595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:49:54.421976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:49:54.421946 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:50:14.717699 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.717667 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:50:14.718092 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.717990 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" containerName="main" Jul 21 06:50:14.718092 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.718002 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" containerName="main" Jul 21 06:50:14.718092 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.718070 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c97eea0-6f6b-4713-818b-46025c0c1bb0" containerName="main" Jul 21 06:50:14.720900 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.720884 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.726479 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.726450 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1ae2daad\"/\"openshift-service-ca.crt\"" Jul 21 06:50:14.728148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.728104 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1ae2daad\"/\"kube-root-ca.crt\"" Jul 21 06:50:14.728252 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.728150 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1ae2daad\"/\"default-dockercfg-95q6w\"" Jul 21 06:50:14.728252 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.728195 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1ae2daad\"/\"e2e-lifecycle-model-1ae2daad-kserve-self-signed-certs\"" Jul 21 06:50:14.737589 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.737566 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:50:14.796313 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.796499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j22hg\" (UniqueName: \"kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.796499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796377 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.796499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796419 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.796499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796438 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.796499 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.796452 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.809289 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.809257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:50:14.897596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.897596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.897596 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897613 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.897897 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.897897 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j22hg\" (UniqueName: \"kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.897897 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.898044 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.897968 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.898094 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.898073 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.898179 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.898088 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.900077 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.900058 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.900437 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.900421 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:14.908003 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:14.907981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j22hg\" (UniqueName: \"kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg\") pod \"e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:15.030309 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:15.030269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:15.168637 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:15.168609 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:50:15.170186 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:50:15.170156 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd1c89a6_a9aa_406f_9b3e_984b190ea8b9.slice/crio-fe04470bfcb3a9c720fefc66cd3b9ae6d21db2b1bc599712802edfe283b372c6 WatchSource:0}: Error finding container fe04470bfcb3a9c720fefc66cd3b9ae6d21db2b1bc599712802edfe283b372c6: Status 404 returned error can't find the container with id fe04470bfcb3a9c720fefc66cd3b9ae6d21db2b1bc599712802edfe283b372c6 Jul 21 06:50:15.294519 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:15.294422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" event={"ID":"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9","Type":"ContainerStarted","Data":"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04"} Jul 21 06:50:15.294519 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:15.294475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" event={"ID":"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9","Type":"ContainerStarted","Data":"fe04470bfcb3a9c720fefc66cd3b9ae6d21db2b1bc599712802edfe283b372c6"} Jul 21 06:50:15.315915 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:15.315852 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" podStartSLOduration=1.315835345 podStartE2EDuration="1.315835345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:50:15.314160274 +0000 UTC m=+1953.894941469" watchObservedRunningTime="2026-07-21 06:50:15.315835345 +0000 UTC m=+1953.896616538" Jul 21 06:50:18.000335 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:18.000301 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:50:25.030976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:25.030938 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:25.031444 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:25.030992 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:25.043506 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:25.043486 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:25.348062 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:25.347975 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:50:33.088791 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:33.088715 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:50:50.896477 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:50.896438 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:50:52.212597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:52.212564 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:50:56.595338 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:56.595286 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:50:58.879713 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:58.879671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:50:59.299984 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:50:59.299947 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:51:03.865751 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:03.865716 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:51:03.913976 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:03.913944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:18.886015 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:18.885952 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" podUID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" containerName="main" containerID="cri-o://75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04" gracePeriod=45 Jul 21 06:51:19.138057 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.138002 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:51:19.255831 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255797 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.255831 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255836 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.256076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255869 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.256076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255896 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.256076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255915 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.256076 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.255988 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j22hg\" (UniqueName: \"kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg\") pod \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\" (UID: \"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9\") " Jul 21 06:51:19.256317 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.256094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:51:19.256317 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.256242 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:51:19.256317 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.256257 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home" (OuterVolumeSpecName: "home") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:51:19.258366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.258337 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:51:19.258590 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.258364 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm" (OuterVolumeSpecName: "dshm") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:51:19.258590 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.258420 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg" (OuterVolumeSpecName: "kube-api-access-j22hg") pod "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" (UID: "bd1c89a6-a9aa-406f-9b3e-984b190ea8b9"). InnerVolumeSpecName "kube-api-access-j22hg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:51:19.356672 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356633 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.356672 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356664 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.356672 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356676 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j22hg\" (UniqueName: \"kubernetes.io/projected/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-kube-api-access-j22hg\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.356913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356684 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.356913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356693 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.356913 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.356700 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:51:19.577999 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.577960 2572 generic.go:356] "Generic (PLEG): container finished" podID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" containerID="75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04" exitCode=0 Jul 21 06:51:19.578202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.578024 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" Jul 21 06:51:19.578202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.578041 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" event={"ID":"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9","Type":"ContainerDied","Data":"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04"} Jul 21 06:51:19.578202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.578082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn" event={"ID":"bd1c89a6-a9aa-406f-9b3e-984b190ea8b9","Type":"ContainerDied","Data":"fe04470bfcb3a9c720fefc66cd3b9ae6d21db2b1bc599712802edfe283b372c6"} Jul 21 06:51:19.578202 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.578100 2572 scope.go:117] "RemoveContainer" containerID="75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04" Jul 21 06:51:19.587449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.587422 2572 scope.go:117] "RemoveContainer" containerID="75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04" Jul 21 06:51:19.587714 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:51:19.587696 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04\": container with ID starting with 75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04 not found: ID does not exist" containerID="75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04" Jul 21 06:51:19.587793 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.587723 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04"} err="failed to get container status \"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04\": rpc error: code = NotFound desc = could not find container \"75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04\": container with ID starting with 75579fd90c3a92a4f4c7cd2b9fbdac7f440f11dc210bb28976c37835f68c5f04 not found: ID does not exist" Jul 21 06:51:19.599947 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.599923 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:51:19.603213 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.603194 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1ae2daad/e2e-lifecycle-model-1ae2daad-kserve-5668df68cf-xh7fn"] Jul 21 06:51:19.961911 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:19.961831 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" path="/var/lib/kubelet/pods/bd1c89a6-a9aa-406f-9b3e-984b190ea8b9/volumes" Jul 21 06:51:27.745249 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:27.745213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:40.398370 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:40.398339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:40.889940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:40.889906 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:46.350441 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:46.350399 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:51.816956 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:51.816915 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:51.917996 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:51.917954 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:52.122294 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:52.122200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:52.355595 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:52.355561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:53.436984 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:53.436951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:53.535140 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:53.535078 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:53.635797 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:53.635761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:54.438727 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:54.438688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:54.535669 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:54.535628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:54.635671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:54.635631 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:51:55.792108 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:55.792063 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:51:56.103838 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:51:56.103758 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:03.120092 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:03.120006 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:03.219399 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:03.219366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:03.818150 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:03.818100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:05.102987 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:05.102949 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:52:09.523178 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:09.523137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:09.585996 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:09.585967 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:09.671422 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:09.671389 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:09.770446 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:09.770412 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:13.318803 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:13.318766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:13.419889 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:13.419852 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:20.284108 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:20.284071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:20.648183 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:20.648080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:41.634169 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:41.634129 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:42.021721 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:42.021692 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:52:42.022384 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:42.022361 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:52:42.025305 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:42.025285 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:52:42.025965 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:42.025944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:52:47.831536 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:47.831497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:47.932322 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:47.932288 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:48.213665 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:48.213585 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:48.627668 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:48.627634 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:48.716647 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:48.716616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:51.248476 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:51.248438 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:51.347897 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:51.347863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:51.449697 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:51.449665 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:51.742419 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:51.742387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:51.928372 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:51.928342 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:52.029301 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:52.029268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:55.768720 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:55.768686 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:56.177364 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:56.177268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:56.506038 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:56.505913 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:57.070123 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:57.070090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:58.792094 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:58.792057 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:52:59.282962 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:59.282924 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:59.474669 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:59.474639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:59.568904 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:59.568817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:52:59.831874 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:52:59.831794 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:00.006740 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:00.006697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:00.107366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:00.107270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:03.779397 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:03.779359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:11.848844 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:11.848810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:13.403239 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:13.403198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:53:13.732858 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:13.732774 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:13.857974 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:13.857942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:16.612182 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.612146 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:53:16.612583 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.612444 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" containerName="main" Jul 21 06:53:16.612583 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.612455 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" containerName="main" Jul 21 06:53:16.612583 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.612530 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1c89a6-a9aa-406f-9b3e-984b190ea8b9" containerName="main" Jul 21 06:53:16.615443 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.615423 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.619736 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.619706 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6d945c\"/\"openshift-service-ca.crt\"" Jul 21 06:53:16.619882 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.619715 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6d945c\"/\"test-model-6d945c-kserve-self-signed-certs\"" Jul 21 06:53:16.619958 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.619891 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6d945c\"/\"default-dockercfg-6jm84\"" Jul 21 06:53:16.620024 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.620007 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6d945c\"/\"kube-root-ca.crt\"" Jul 21 06:53:16.625772 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.625748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:53:16.630825 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.630803 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:16.633898 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.633877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.633996 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.633925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.633996 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.633967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.634105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.634019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.634105 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.634059 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqmzg\" (UniqueName: \"kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.634215 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.634135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734696 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqmzg\" (UniqueName: \"kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.734902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.734879 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.735314 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.735288 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.735422 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.735335 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.735422 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.735357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.737234 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.737207 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.737495 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.737476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.743182 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.743165 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqmzg\" (UniqueName: \"kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg\") pod \"test-model-6d945c-kserve-c58dd8c99-kn4cc\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:16.925173 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:16.925050 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:17.065366 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:17.065341 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:53:17.066913 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:53:17.066886 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f018866_c88f_42de_9045_0bed53610f87.slice/crio-614844a103e76977a84afc7ca53686bec650f4d1a658913523af8ad92dde60dc WatchSource:0}: Error finding container 614844a103e76977a84afc7ca53686bec650f4d1a658913523af8ad92dde60dc: Status 404 returned error can't find the container with id 614844a103e76977a84afc7ca53686bec650f4d1a658913523af8ad92dde60dc Jul 21 06:53:17.089720 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:17.089693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" event={"ID":"6f018866-c88f-42de-9045-0bed53610f87","Type":"ContainerStarted","Data":"614844a103e76977a84afc7ca53686bec650f4d1a658913523af8ad92dde60dc"} Jul 21 06:53:18.095937 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:18.095892 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" event={"ID":"6f018866-c88f-42de-9045-0bed53610f87","Type":"ContainerStarted","Data":"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff"} Jul 21 06:53:18.114193 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:18.114134 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" podStartSLOduration=2.114097481 podStartE2EDuration="2.114097481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:53:18.113753492 +0000 UTC m=+2136.694534689" watchObservedRunningTime="2026-07-21 06:53:18.114097481 +0000 UTC m=+2136.694878675" Jul 21 06:53:20.834822 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:20.834789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:20.934855 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:20.934822 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:23.293964 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:23.293931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:53:26.925940 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:26.925893 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:26.926431 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:26.925986 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:26.938412 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:26.938383 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:27.146774 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:27.146742 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:53:53.617174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.617070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:53:53.632151 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.632101 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:53:53.635299 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.635284 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.640161 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.640137 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-11b68c\"/\"openshift-service-ca.crt\"" Jul 21 06:53:53.640161 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.640150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-11b68c\"/\"kube-root-ca.crt\"" Jul 21 06:53:53.640324 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.640162 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-11b68c\"/\"test-model-11b68c-kserve-self-signed-certs\"" Jul 21 06:53:53.640386 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.640352 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-11b68c\"/\"default-dockercfg-7vcds\"" Jul 21 06:53:53.646866 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.646841 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:53:53.764744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.764744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.764969 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.764969 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.764969 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.764969 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.764936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxf6\" (UniqueName: \"kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865545 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865497 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865545 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxf6\" (UniqueName: \"kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.865802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.866070 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.865973 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.866070 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.866021 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.866070 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.866041 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.868080 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.868026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.868361 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.868345 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.877857 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.877820 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxf6\" (UniqueName: \"kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6\") pod \"test-model-11b68c-kserve-6dd78c4f9f-jsrfx\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:53.945278 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:53.945239 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:53:54.081858 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:54.081836 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:53:54.083763 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:53:54.083729 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda396f46f_8a91_4a81_94f5_806627648e69.slice/crio-90a17bd9a4842798d214435af9b3b4ec7547ef6ee39e29e163b5b6aa9b85b933 WatchSource:0}: Error finding container 90a17bd9a4842798d214435af9b3b4ec7547ef6ee39e29e163b5b6aa9b85b933: Status 404 returned error can't find the container with id 90a17bd9a4842798d214435af9b3b4ec7547ef6ee39e29e163b5b6aa9b85b933 Jul 21 06:53:54.255587 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:54.255548 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" event={"ID":"a396f46f-8a91-4a81-94f5-806627648e69","Type":"ContainerStarted","Data":"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24"} Jul 21 06:53:54.255766 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:54.255598 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" event={"ID":"a396f46f-8a91-4a81-94f5-806627648e69","Type":"ContainerStarted","Data":"90a17bd9a4842798d214435af9b3b4ec7547ef6ee39e29e163b5b6aa9b85b933"} Jul 21 06:53:54.274513 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:54.274464 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" podStartSLOduration=1.274450299 podStartE2EDuration="1.274450299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:53:54.27239765 +0000 UTC m=+2172.853178835" watchObservedRunningTime="2026-07-21 06:53:54.274450299 +0000 UTC m=+2172.855231493" Jul 21 06:53:57.990597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:53:57.990564 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:54:03.945387 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:03.945344 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:54:03.945387 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:03.945393 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:54:03.961530 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:03.961499 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:54:04.308802 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:04.308768 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:54:11.791296 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:11.791256 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:54:33.748331 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:33.748302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:33.830331 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:33.830293 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:44.179437 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:44.179405 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:54:44.200871 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:44.200839 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:45.200856 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:45.200810 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:54:45.219949 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:45.219912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:45.844998 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:45.844960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:45.945848 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:45.945813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:48.630828 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:48.630789 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:54:50.823823 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:50.823788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:55.815731 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:55.815694 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:54:59.200018 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.199978 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" podUID="6f018866-c88f-42de-9045-0bed53610f87" containerName="main" containerID="cri-o://7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff" gracePeriod=45 Jul 21 06:54:59.459480 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.459398 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:54:59.528574 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.528535 2572 generic.go:356] "Generic (PLEG): container finished" podID="6f018866-c88f-42de-9045-0bed53610f87" containerID="7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff" exitCode=0 Jul 21 06:54:59.528574 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.528571 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" Jul 21 06:54:59.528770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.528628 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" event={"ID":"6f018866-c88f-42de-9045-0bed53610f87","Type":"ContainerDied","Data":"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff"} Jul 21 06:54:59.528770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.528667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc" event={"ID":"6f018866-c88f-42de-9045-0bed53610f87","Type":"ContainerDied","Data":"614844a103e76977a84afc7ca53686bec650f4d1a658913523af8ad92dde60dc"} Jul 21 06:54:59.528770 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.528685 2572 scope.go:117] "RemoveContainer" containerID="7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff" Jul 21 06:54:59.536903 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.536885 2572 scope.go:117] "RemoveContainer" containerID="7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff" Jul 21 06:54:59.537172 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:54:59.537153 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff\": container with ID starting with 7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff not found: ID does not exist" containerID="7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff" Jul 21 06:54:59.537223 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.537181 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff"} err="failed to get container status \"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff\": rpc error: code = NotFound desc = could not find container \"7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff\": container with ID starting with 7869326f13c2ca9e8e2afc8d29a937dbe16109c5c5b585ed991f0590bfeacbff not found: ID does not exist" Jul 21 06:54:59.540448 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540432 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540513 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540471 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540568 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540568 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540534 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540568 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540555 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqmzg\" (UniqueName: \"kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540715 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540583 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir\") pod \"6f018866-c88f-42de-9045-0bed53610f87\" (UID: \"6f018866-c88f-42de-9045-0bed53610f87\") " Jul 21 06:54:59.540818 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540793 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:54:59.540894 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540802 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home" (OuterVolumeSpecName: "home") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:54:59.540945 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.540891 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:54:59.542781 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.542763 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm" (OuterVolumeSpecName: "dshm") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:54:59.542860 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.542801 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:54:59.542860 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.542845 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg" (OuterVolumeSpecName: "kube-api-access-xqmzg") pod "6f018866-c88f-42de-9045-0bed53610f87" (UID: "6f018866-c88f-42de-9045-0bed53610f87"). InnerVolumeSpecName "kube-api-access-xqmzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:54:59.641666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641617 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.641666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641657 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f018866-c88f-42de-9045-0bed53610f87-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.641666 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641672 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.641908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641682 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.641908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641694 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqmzg\" (UniqueName: \"kubernetes.io/projected/6f018866-c88f-42de-9045-0bed53610f87-kube-api-access-xqmzg\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.641908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.641705 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f018866-c88f-42de-9045-0bed53610f87-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:54:59.854160 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.854130 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:54:59.857160 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.857137 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6d945c/test-model-6d945c-kserve-c58dd8c99-kn4cc"] Jul 21 06:54:59.962585 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:54:59.962552 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f018866-c88f-42de-9045-0bed53610f87" path="/var/lib/kubelet/pods/6f018866-c88f-42de-9045-0bed53610f87/volumes" Jul 21 06:55:00.221509 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.221418 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" podUID="a396f46f-8a91-4a81-94f5-806627648e69" containerName="main" containerID="cri-o://851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24" gracePeriod=45 Jul 21 06:55:00.445102 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.445069 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:00.478139 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.478063 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:55:00.534558 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.534522 2572 generic.go:356] "Generic (PLEG): container finished" podID="a396f46f-8a91-4a81-94f5-806627648e69" containerID="851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24" exitCode=0 Jul 21 06:55:00.534744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.534563 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" Jul 21 06:55:00.534744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.534599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" event={"ID":"a396f46f-8a91-4a81-94f5-806627648e69","Type":"ContainerDied","Data":"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24"} Jul 21 06:55:00.534744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.534644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx" event={"ID":"a396f46f-8a91-4a81-94f5-806627648e69","Type":"ContainerDied","Data":"90a17bd9a4842798d214435af9b3b4ec7547ef6ee39e29e163b5b6aa9b85b933"} Jul 21 06:55:00.534744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.534666 2572 scope.go:117] "RemoveContainer" containerID="851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24" Jul 21 06:55:00.542817 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.542801 2572 scope.go:117] "RemoveContainer" containerID="851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24" Jul 21 06:55:00.543089 ip-10-0-136-215 kubenswrapper[2572]: E0721 06:55:00.543067 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24\": container with ID starting with 851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24 not found: ID does not exist" containerID="851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24" Jul 21 06:55:00.543167 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.543101 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24"} err="failed to get container status \"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24\": rpc error: code = NotFound desc = could not find container \"851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24\": container with ID starting with 851ad3ef5e0f7f9e91e30dcc9aa635c8b49e29cd18ea718dacc4f2e33f428b24 not found: ID does not exist" Jul 21 06:55:00.549314 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549296 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549406 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549322 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549406 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549363 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549406 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549388 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549552 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549408 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nxf6\" (UniqueName: \"kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549552 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549459 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home\") pod \"a396f46f-8a91-4a81-94f5-806627648e69\" (UID: \"a396f46f-8a91-4a81-94f5-806627648e69\") " Jul 21 06:55:00.549650 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549591 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:55:00.549707 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549678 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache" (OuterVolumeSpecName: "model-cache") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:55:00.549773 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549697 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.549773 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.549751 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home" (OuterVolumeSpecName: "home") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:55:00.551803 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.551777 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm" (OuterVolumeSpecName: "dshm") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 06:55:00.551803 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.551791 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 06:55:00.551962 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.551812 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6" (OuterVolumeSpecName: "kube-api-access-4nxf6") pod "a396f46f-8a91-4a81-94f5-806627648e69" (UID: "a396f46f-8a91-4a81-94f5-806627648e69"). InnerVolumeSpecName "kube-api-access-4nxf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 06:55:00.650432 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.650398 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a396f46f-8a91-4a81-94f5-806627648e69-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.650432 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.650429 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nxf6\" (UniqueName: \"kubernetes.io/projected/a396f46f-8a91-4a81-94f5-806627648e69-kube-api-access-4nxf6\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.650637 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.650441 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.650637 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.650449 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.650637 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.650457 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a396f46f-8a91-4a81-94f5-806627648e69-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 06:55:00.724902 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.724873 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:55:00.886536 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.886501 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:55:00.910810 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:00.910765 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-11b68c/test-model-11b68c-kserve-6dd78c4f9f-jsrfx"] Jul 21 06:55:01.067853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:01.067818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:01.960811 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:01.960779 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a396f46f-8a91-4a81-94f5-806627648e69" path="/var/lib/kubelet/pods/a396f46f-8a91-4a81-94f5-806627648e69/volumes" Jul 21 06:55:07.510304 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:07.510216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:07.644598 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:07.644561 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:07.917762 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:07.917667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:08.092823 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:08.092790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:09.282597 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:09.282566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:09.407077 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:09.407045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:19.109710 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:19.109668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:21.924843 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:21.924807 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:55:23.322393 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:23.322358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:23.778229 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:23.778200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:29.935025 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:29.934988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:30.034768 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:30.034734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:30.277096 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:30.277063 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:30.493640 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:30.493600 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:30.940148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:30.940097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:31.287098 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:31.287066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:31.407675 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:31.407639 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:34.365694 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:34.365655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:34.467570 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:34.467537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:34.584102 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:34.584062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:34.740515 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:34.740425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:35.099253 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:35.099224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:35.218946 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:35.218919 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:39.066671 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:39.066620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:39.312659 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:39.312609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:39.678257 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:39.678222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:39.840168 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:39.840136 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:41.769369 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:41.769332 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:55:42.715680 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:42.715645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:42.980807 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:42.980720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:43.122755 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:43.122725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:43.302364 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:43.302320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:44.104359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:44.104318 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:44.248927 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:44.248890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:47.194048 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:47.194012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:56.346896 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:56.346860 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:55:57.579800 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:55:57.579760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:00.520359 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:00.520323 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:56:05.313380 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:05.313338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:05.437521 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:05.437472 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:10.719611 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:10.719571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:15.939002 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:15.938962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:16.042619 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:16.042584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:16.903870 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:16.903833 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:56:22.562960 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:22.562921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:22.893394 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:22.893302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:22.965664 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:22.965629 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:23.070710 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:23.070673 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:28.907137 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:28.907083 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:38.774524 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:38.774434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:43.334997 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:43.334956 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:43.419290 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:43.419259 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:56:43.762095 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:43.762054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:48.600860 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:48.600816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:50.568424 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:50.568387 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:50.663593 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:50.663558 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:50.913434 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:50.913339 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:51.173925 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:51.173849 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:51.551183 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:51.551133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:51.962313 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:51.962232 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:52.347929 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:52.347892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:54.817800 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:54.817765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:54.923413 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:54.923379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:55.222589 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:55.222511 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:55.435910 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:55.435885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:55.881651 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:55.881620 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:55.983535 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:55.983499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:57.994566 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:57.994530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:59.350425 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:59.350386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:56:59.705307 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:56:59.705226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:00.029024 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:00.028988 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:00.544608 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:00.544578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:02.825414 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:02.825379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:02.912092 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:02.912056 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:57:02.929131 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:02.929068 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:03.142292 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:03.142213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:03.348632 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:03.348595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:03.720821 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:03.720780 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:03.823518 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:03.823485 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:07.348685 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:07.348650 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:14.465148 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:14.465091 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:14.566050 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:14.566011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:16.799744 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:16.799709 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:16.904914 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:16.904880 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:17.801147 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:17.801101 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:57:24.794336 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:24.794305 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:24.894773 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:24.894735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:31.492832 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.492796 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493253 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f018866-c88f-42de-9045-0bed53610f87" containerName="main" Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493269 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f018866-c88f-42de-9045-0bed53610f87" containerName="main" Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493300 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a396f46f-8a91-4a81-94f5-806627648e69" containerName="main" Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493309 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a396f46f-8a91-4a81-94f5-806627648e69" containerName="main" Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493386 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a396f46f-8a91-4a81-94f5-806627648e69" containerName="main" Jul 21 06:57:31.493503 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.493400 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f018866-c88f-42de-9045-0bed53610f87" containerName="main" Jul 21 06:57:31.496579 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.496557 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.501273 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.501250 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"default-dockercfg-z9xv6\"" Jul 21 06:57:31.501449 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.501250 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"kube-root-ca.crt\"" Jul 21 06:57:31.501526 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.501250 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"openshift-service-ca.crt\"" Jul 21 06:57:31.501526 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.501278 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"auth-test-model-08eb3e-kserve-self-signed-certs\"" Jul 21 06:57:31.506310 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.506289 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 06:57:31.531665 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.531628 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:31.587853 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.587813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpwqq\" (UniqueName: \"kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.587972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.587863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.587972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.587920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.587972 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.587966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.588087 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.588020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.588087 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.588040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689201 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689158 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpwqq\" (UniqueName: \"kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689375 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689374 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689642 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689529 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689642 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689588 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.689753 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.689653 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.691706 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.691685 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.692102 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.692080 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.699488 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.699458 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpwqq\" (UniqueName: \"kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq\") pod \"auth-test-model-08eb3e-kserve-847565967-kqvnj\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.806295 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.806254 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:31.941928 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:31.941901 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 06:57:31.944512 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:57:31.944475 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b33c93b_f992_4436_954d_ba95a6b0b535.slice/crio-69fee13c770c68fef9679ccbc50675e8dbc7c3e1d7f2dbfbaebd2e0c13b3598a WatchSource:0}: Error finding container 69fee13c770c68fef9679ccbc50675e8dbc7c3e1d7f2dbfbaebd2e0c13b3598a: Status 404 returned error can't find the container with id 69fee13c770c68fef9679ccbc50675e8dbc7c3e1d7f2dbfbaebd2e0c13b3598a Jul 21 06:57:32.192008 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:32.191924 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" event={"ID":"2b33c93b-f992-4436-954d-ba95a6b0b535","Type":"ContainerStarted","Data":"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea"} Jul 21 06:57:32.192008 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:32.191969 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" event={"ID":"2b33c93b-f992-4436-954d-ba95a6b0b535","Type":"ContainerStarted","Data":"69fee13c770c68fef9679ccbc50675e8dbc7c3e1d7f2dbfbaebd2e0c13b3598a"} Jul 21 06:57:32.214869 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:32.214823 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" podStartSLOduration=1.21480737 podStartE2EDuration="1.21480737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:57:32.21453952 +0000 UTC m=+2390.795320715" watchObservedRunningTime="2026-07-21 06:57:32.21480737 +0000 UTC m=+2390.795588541" Jul 21 06:57:34.992764 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:34.992727 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:57:41.807224 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:41.807172 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:41.807224 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:41.807232 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:41.820361 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:41.820337 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:42.045772 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:42.045738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:57:42.048173 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:42.048152 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 06:57:42.049231 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:42.049214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:57:42.051635 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:42.051616 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jd96j_c286da15-b3f5-4ecb-b065-9451fa1f6506/ovn-acl-logging/0.log" Jul 21 06:57:42.257300 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:42.257216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 06:57:50.501226 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.501193 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 06:57:50.504377 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.504356 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.507572 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.507547 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"openshift-service-ca.crt\"" Jul 21 06:57:50.509022 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.508993 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"auth-test-model-bddf64-kserve-self-signed-certs\"" Jul 21 06:57:50.509022 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.509022 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"kube-root-ca.crt\"" Jul 21 06:57:50.509225 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.508993 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"default-dockercfg-jkqpz\"" Jul 21 06:57:50.522276 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.522243 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 06:57:50.545013 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.544977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.545174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.545019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.545174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.545045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclpn\" (UniqueName: \"kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.545174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.545071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.545174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.545101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.545174 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.545131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.558452 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.558429 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:57:50.645679 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.645842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.645842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645723 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nclpn\" (UniqueName: \"kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.645842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.645842 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.646026 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.645864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.646259 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.646238 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.646259 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.646256 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.646393 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.646294 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.648224 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.648208 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.648500 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.648485 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.655868 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.655845 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclpn\" (UniqueName: \"kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn\") pod \"auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.814093 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.814054 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:57:50.952149 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:50.952102 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 06:57:50.954966 ip-10-0-136-215 kubenswrapper[2572]: W0721 06:57:50.954932 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8b34a0f_0e20_4c74_b804_275fc76a7d66.slice/crio-f7b21ac4973b18c8b901f13fd40fa1c732059f0bc70df1418d9751cbb40c4500 WatchSource:0}: Error finding container f7b21ac4973b18c8b901f13fd40fa1c732059f0bc70df1418d9751cbb40c4500: Status 404 returned error can't find the container with id f7b21ac4973b18c8b901f13fd40fa1c732059f0bc70df1418d9751cbb40c4500 Jul 21 06:57:51.282458 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:51.282425 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" event={"ID":"c8b34a0f-0e20-4c74-b804-275fc76a7d66","Type":"ContainerStarted","Data":"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2"} Jul 21 06:57:51.282458 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:51.282464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" event={"ID":"c8b34a0f-0e20-4c74-b804-275fc76a7d66","Type":"ContainerStarted","Data":"f7b21ac4973b18c8b901f13fd40fa1c732059f0bc70df1418d9751cbb40c4500"} Jul 21 06:57:51.303639 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:51.303595 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" podStartSLOduration=1.303580001 podStartE2EDuration="1.303580001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:57:51.301923932 +0000 UTC m=+2409.882705128" watchObservedRunningTime="2026-07-21 06:57:51.303580001 +0000 UTC m=+2409.884361195" Jul 21 06:57:54.491279 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:57:54.491243 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:58:00.814916 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:00.814878 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:58:00.815374 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:00.814939 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:58:00.827464 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:00.827437 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:58:01.339536 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:01.339503 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 06:58:14.812204 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:14.812165 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:58:32.898463 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:32.898425 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:58:50.186719 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:58:50.186680 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:59:06.697049 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:06.697012 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:59:06.885519 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:06.885490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:06.987576 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:06.987492 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:24.012292 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:24.012250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:59:37.161556 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:37.161463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:37.223747 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:37.223719 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:43.598371 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:43.598331 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 06:59:55.899376 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:55.899333 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 06:59:55.920577 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:55.920547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:56.988428 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:56.988394 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 06:59:57.012908 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:57.012876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 06:59:59.626064 ip-10-0-136-215 kubenswrapper[2572]: I0721 06:59:59.626032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:04.216888 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:04.216850 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:00:10.919966 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:10.919922 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" podUID="2b33c93b-f992-4436-954d-ba95a6b0b535" containerName="main" containerID="cri-o://68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea" gracePeriod=45 Jul 21 07:00:11.164562 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.164533 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 07:00:11.236411 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236319 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236411 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236368 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236614 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236434 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236614 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236474 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236614 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236513 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236614 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236554 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpwqq\" (UniqueName: \"kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq\") pod \"2b33c93b-f992-4436-954d-ba95a6b0b535\" (UID: \"2b33c93b-f992-4436-954d-ba95a6b0b535\") " Jul 21 07:00:11.236614 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236574 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home" (OuterVolumeSpecName: "home") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:11.236833 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236688 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:11.236833 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236781 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:11.236941 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236868 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.236941 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236880 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.236941 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.236889 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.238784 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.238759 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm" (OuterVolumeSpecName: "dshm") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:11.238941 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.238795 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:00:11.238941 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.238873 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq" (OuterVolumeSpecName: "kube-api-access-cpwqq") pod "2b33c93b-f992-4436-954d-ba95a6b0b535" (UID: "2b33c93b-f992-4436-954d-ba95a6b0b535"). InnerVolumeSpecName "kube-api-access-cpwqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:00:11.337489 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.337448 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpwqq\" (UniqueName: \"kubernetes.io/projected/2b33c93b-f992-4436-954d-ba95a6b0b535-kube-api-access-cpwqq\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.337489 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.337480 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b33c93b-f992-4436-954d-ba95a6b0b535-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.337489 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.337495 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b33c93b-f992-4436-954d-ba95a6b0b535-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:11.895258 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.895227 2572 generic.go:356] "Generic (PLEG): container finished" podID="2b33c93b-f992-4436-954d-ba95a6b0b535" containerID="68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea" exitCode=0 Jul 21 07:00:11.895464 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.895271 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" Jul 21 07:00:11.895464 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.895289 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" event={"ID":"2b33c93b-f992-4436-954d-ba95a6b0b535","Type":"ContainerDied","Data":"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea"} Jul 21 07:00:11.895464 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.895320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj" event={"ID":"2b33c93b-f992-4436-954d-ba95a6b0b535","Type":"ContainerDied","Data":"69fee13c770c68fef9679ccbc50675e8dbc7c3e1d7f2dbfbaebd2e0c13b3598a"} Jul 21 07:00:11.895464 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.895336 2572 scope.go:117] "RemoveContainer" containerID="68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea" Jul 21 07:00:11.904173 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.904154 2572 scope.go:117] "RemoveContainer" containerID="68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea" Jul 21 07:00:11.904409 ip-10-0-136-215 kubenswrapper[2572]: E0721 07:00:11.904391 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea\": container with ID starting with 68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea not found: ID does not exist" containerID="68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea" Jul 21 07:00:11.904476 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.904424 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea"} err="failed to get container status \"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea\": rpc error: code = NotFound desc = could not find container \"68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea\": container with ID starting with 68d81e7f316429b80db6f3db207c87ad462dd5e4ac640e3ff44048cf5cdf27ea not found: ID does not exist" Jul 21 07:00:11.916035 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.916013 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 07:00:11.922648 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.922622 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/auth-test-model-08eb3e-kserve-847565967-kqvnj"] Jul 21 07:00:11.961196 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:11.961170 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b33c93b-f992-4436-954d-ba95a6b0b535" path="/var/lib/kubelet/pods/2b33c93b-f992-4436-954d-ba95a6b0b535/volumes" Jul 21 07:00:12.008411 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.008378 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" podUID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" containerName="main" containerID="cri-o://d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2" gracePeriod=45 Jul 21 07:00:12.262295 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.262264 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 07:00:12.348320 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348287 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348320 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348325 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348591 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348367 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348591 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348411 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348591 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348434 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348591 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348467 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nclpn\" (UniqueName: \"kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn\") pod \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\" (UID: \"c8b34a0f-0e20-4c74-b804-275fc76a7d66\") " Jul 21 07:00:12.348778 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348620 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:12.348778 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348672 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home" (OuterVolumeSpecName: "home") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:12.348778 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.348693 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:12.350862 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.350841 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm" (OuterVolumeSpecName: "dshm") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:00:12.350959 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.350859 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:00:12.350959 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.350868 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn" (OuterVolumeSpecName: "kube-api-access-nclpn") pod "c8b34a0f-0e20-4c74-b804-275fc76a7d66" (UID: "c8b34a0f-0e20-4c74-b804-275fc76a7d66"). InnerVolumeSpecName "kube-api-access-nclpn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449576 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449605 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449615 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449623 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nclpn\" (UniqueName: \"kubernetes.io/projected/c8b34a0f-0e20-4c74-b804-275fc76a7d66-kube-api-access-nclpn\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449634 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.449663 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.449642 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8b34a0f-0e20-4c74-b804-275fc76a7d66-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:00:12.910056 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.910019 2572 generic.go:356] "Generic (PLEG): container finished" podID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" containerID="d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2" exitCode=0 Jul 21 07:00:12.910290 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.910072 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" Jul 21 07:00:12.910290 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.910129 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" event={"ID":"c8b34a0f-0e20-4c74-b804-275fc76a7d66","Type":"ContainerDied","Data":"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2"} Jul 21 07:00:12.910290 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.910173 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k" event={"ID":"c8b34a0f-0e20-4c74-b804-275fc76a7d66","Type":"ContainerDied","Data":"f7b21ac4973b18c8b901f13fd40fa1c732059f0bc70df1418d9751cbb40c4500"} Jul 21 07:00:12.910290 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.910192 2572 scope.go:117] "RemoveContainer" containerID="d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2" Jul 21 07:00:12.919157 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.919139 2572 scope.go:117] "RemoveContainer" containerID="d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2" Jul 21 07:00:12.919434 ip-10-0-136-215 kubenswrapper[2572]: E0721 07:00:12.919415 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2\": container with ID starting with d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2 not found: ID does not exist" containerID="d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2" Jul 21 07:00:12.919491 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.919443 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2"} err="failed to get container status \"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2\": rpc error: code = NotFound desc = could not find container \"d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2\": container with ID starting with d0092af3c7dd6612d762045aa66bc2cbf0073dcdddd661582e5d70ac816035b2 not found: ID does not exist" Jul 21 07:00:12.931324 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.931300 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 07:00:12.934958 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:12.934937 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/auth-test-model-bddf64-kserve-7f48ccdc95-x4h4k"] Jul 21 07:00:13.961347 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:13.961315 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" path="/var/lib/kubelet/pods/c8b34a0f-0e20-4c74-b804-275fc76a7d66/volumes" Jul 21 07:00:23.100465 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100431 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100723 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b33c93b-f992-4436-954d-ba95a6b0b535" containerName="main" Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100734 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b33c93b-f992-4436-954d-ba95a6b0b535" containerName="main" Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100744 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" containerName="main" Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100749 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" containerName="main" Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100806 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b34a0f-0e20-4c74-b804-275fc76a7d66" containerName="main" Jul 21 07:00:23.100882 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.100813 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b33c93b-f992-4436-954d-ba95a6b0b535" containerName="main" Jul 21 07:00:23.103664 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.103645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.106762 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.106730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"sub-test-model-bddf64-kserve-self-signed-certs\"" Jul 21 07:00:23.108221 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.108197 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"kube-root-ca.crt\"" Jul 21 07:00:23.108348 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.108220 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"default-dockercfg-jkqpz\"" Jul 21 07:00:23.108348 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.108269 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-bddf64\"/\"openshift-service-ca.crt\"" Jul 21 07:00:23.112962 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.112939 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:00:23.145197 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.145174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:23.245089 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245053 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.245295 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr92l\" (UniqueName: \"kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.245295 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245200 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.245295 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.245397 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245293 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.245397 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.245332 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346463 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr92l\" (UniqueName: \"kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346463 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346731 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346731 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346507 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346731 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346731 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.346965 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.347015 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346982 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.347015 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.346978 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.348831 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.348809 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.349082 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.349065 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.355748 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.355679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr92l\" (UniqueName: \"kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l\") pod \"sub-test-model-bddf64-kserve-64db44b6dc-wdtp9\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.413984 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.413932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:23.547245 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.547219 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:00:23.549405 ip-10-0-136-215 kubenswrapper[2572]: W0721 07:00:23.549381 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76279f49_0cca_450c_979b_1197a563be67.slice/crio-df6f6e8e0b56a5c0fdd1d33a2960713ab00caca116461030a2e6e7131eda2853 WatchSource:0}: Error finding container df6f6e8e0b56a5c0fdd1d33a2960713ab00caca116461030a2e6e7131eda2853: Status 404 returned error can't find the container with id df6f6e8e0b56a5c0fdd1d33a2960713ab00caca116461030a2e6e7131eda2853 Jul 21 07:00:23.961893 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.961860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" event={"ID":"76279f49-0cca-450c-979b-1197a563be67","Type":"ContainerStarted","Data":"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271"} Jul 21 07:00:23.961893 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.961898 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" event={"ID":"76279f49-0cca-450c-979b-1197a563be67","Type":"ContainerStarted","Data":"df6f6e8e0b56a5c0fdd1d33a2960713ab00caca116461030a2e6e7131eda2853"} Jul 21 07:00:23.979367 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:23.979307 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" podStartSLOduration=0.979289261 podStartE2EDuration="979.289261ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:00:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:00:23.979087116 +0000 UTC m=+2562.559868327" watchObservedRunningTime="2026-07-21 07:00:23.979289261 +0000 UTC m=+2562.560070454" Jul 21 07:00:26.687229 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:26.687196 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:00:33.414142 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:33.414080 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:33.414642 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:33.414158 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:33.426276 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:33.426252 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:34.018450 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:34.018419 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:00:36.899078 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:36.899042 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:00:44.851076 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:44.851034 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:45.798924 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:45.798895 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:00:45.819923 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:45.819892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:46.476178 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:46.476145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:46.576262 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:46.576224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:56.506228 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:56.506190 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:00:56.692940 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:00:56.692892 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:01:00.819224 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:00.819153 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" podUID="76279f49-0cca-450c-979b-1197a563be67" containerName="main" containerID="cri-o://34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271" gracePeriod=45 Jul 21 07:01:01.017532 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.017486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:01.068305 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.068281 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:01:01.123028 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.122932 2572 generic.go:356] "Generic (PLEG): container finished" podID="76279f49-0cca-450c-979b-1197a563be67" containerID="34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271" exitCode=0 Jul 21 07:01:01.123028 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.122978 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" Jul 21 07:01:01.123292 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.123025 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" event={"ID":"76279f49-0cca-450c-979b-1197a563be67","Type":"ContainerDied","Data":"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271"} Jul 21 07:01:01.123292 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.123071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9" event={"ID":"76279f49-0cca-450c-979b-1197a563be67","Type":"ContainerDied","Data":"df6f6e8e0b56a5c0fdd1d33a2960713ab00caca116461030a2e6e7131eda2853"} Jul 21 07:01:01.123292 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.123092 2572 scope.go:117] "RemoveContainer" containerID="34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271" Jul 21 07:01:01.131486 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.131466 2572 scope.go:117] "RemoveContainer" containerID="34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271" Jul 21 07:01:01.131813 ip-10-0-136-215 kubenswrapper[2572]: E0721 07:01:01.131794 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271\": container with ID starting with 34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271 not found: ID does not exist" containerID="34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271" Jul 21 07:01:01.131878 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.131823 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271"} err="failed to get container status \"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271\": rpc error: code = NotFound desc = could not find container \"34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271\": container with ID starting with 34205426ea89088b9ba50d8adf24445c6c84f099ce00a5b2fd3c400f0817c271 not found: ID does not exist" Jul 21 07:01:01.159612 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159583 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr92l\" (UniqueName: \"kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.159794 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159659 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.159794 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159699 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.159794 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159720 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.159794 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159751 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.159794 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159792 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir\") pod \"76279f49-0cca-450c-979b-1197a563be67\" (UID: \"76279f49-0cca-450c-979b-1197a563be67\") " Jul 21 07:01:01.160038 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.159950 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home" (OuterVolumeSpecName: "home") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:01:01.160201 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.160084 2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-home\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.160201 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.160191 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:01:01.160334 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.160211 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache" (OuterVolumeSpecName: "model-cache") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:01:01.161946 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.161919 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm" (OuterVolumeSpecName: "dshm") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 07:01:01.162165 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.162136 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 07:01:01.162579 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.162553 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l" (OuterVolumeSpecName: "kube-api-access-fr92l") pod "76279f49-0cca-450c-979b-1197a563be67" (UID: "76279f49-0cca-450c-979b-1197a563be67"). InnerVolumeSpecName "kube-api-access-fr92l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 07:01:01.261409 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.261367 2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76279f49-0cca-450c-979b-1197a563be67-tls-certs\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.261409 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.261418 2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-tmp-dir\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.261613 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.261429 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr92l\" (UniqueName: \"kubernetes.io/projected/76279f49-0cca-450c-979b-1197a563be67-kube-api-access-fr92l\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.261613 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.261440 2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-dshm\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.261613 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.261450 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/76279f49-0cca-450c-979b-1197a563be67-model-cache\") on node \"ip-10-0-136-215.ec2.internal\" DevicePath \"\"" Jul 21 07:01:01.450219 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.450185 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:01:01.461559 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.461525 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-bddf64/sub-test-model-bddf64-kserve-64db44b6dc-wdtp9"] Jul 21 07:01:01.961377 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:01.961343 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76279f49-0cca-450c-979b-1197a563be67" path="/var/lib/kubelet/pods/76279f49-0cca-450c-979b-1197a563be67/volumes" Jul 21 07:01:02.555517 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:02.555486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:04.994560 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:04.994477 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:01:07.413581 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:07.413545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:07.514537 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:07.514505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:07.721052 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:07.720949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:07.933914 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:07.933884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:08.701470 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:08.701440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:08.802930 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:08.802896 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:18.588657 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:18.588625 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:21.493343 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:21.493305 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5fn7h"] Jul 21 07:01:23.140212 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:23.140177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:23.536474 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:23.536439 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:29.415837 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:29.415797 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:29.527841 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:29.527797 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:29.699145 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:29.699037 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:29.918992 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:29.918962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:30.339552 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:30.339520 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74f6ddbb8d-zndvf_092a4d05-337e-4ad4-a87b-2852c0cf12f8/authorino/0.log" Jul 21 07:01:36.630734 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:36.630704 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-hjg9r_5cf6e4fb-863c-4b4f-ad91-c97e33b31c38/copy-manifests/0.log" Jul 21 07:01:36.637460 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:36.637426 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-hjg9r_5cf6e4fb-863c-4b4f-ad91-c97e33b31c38/manager/0.log" Jul 21 07:01:38.723736 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:38.723705 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74f6ddbb8d-zndvf_092a4d05-337e-4ad4-a87b-2852c0cf12f8/authorino/0.log" Jul 21 07:01:39.431009 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:39.430979 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5fn7h_1e28ad52-0398-4812-b6ea-6e7ba13ffae1/limitador/0.log" Jul 21 07:01:40.148622 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:40.148567 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff9c87565-m2n2q_6f6215e1-a3f6-4a88-ad0c-55aeccde246e/kube-auth-proxy/0.log" Jul 21 07:01:41.556534 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:41.556507 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fz6dh_e252f8a9-7604-42c6-adca-77711c884615/main/0.log" Jul 21 07:01:41.667814 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:41.667783 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-n9gr8_4e4e8844-1fdd-411e-942f-8ecfe325f435/main/0.log" Jul 21 07:01:47.047068 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.047029 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mtl9f/must-gather-lrsjf"] Jul 21 07:01:47.047501 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.047336 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76279f49-0cca-450c-979b-1197a563be67" containerName="main" Jul 21 07:01:47.047501 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.047348 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76279f49-0cca-450c-979b-1197a563be67" containerName="main" Jul 21 07:01:47.047501 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.047408 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76279f49-0cca-450c-979b-1197a563be67" containerName="main" Jul 21 07:01:47.051696 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.051675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.057052 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.057028 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtl9f\"/\"kube-root-ca.crt\"" Jul 21 07:01:47.057494 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.057475 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtl9f\"/\"openshift-service-ca.crt\"" Jul 21 07:01:47.058373 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.058025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mtl9f\"/\"default-dockercfg-qq7rw\"" Jul 21 07:01:47.072887 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.072860 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/must-gather-lrsjf"] Jul 21 07:01:47.127276 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.127233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57dqx\" (UniqueName: \"kubernetes.io/projected/d76facb4-1f7d-4eb7-9368-99168ab2771d-kube-api-access-57dqx\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.127467 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.127300 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d76facb4-1f7d-4eb7-9368-99168ab2771d-must-gather-output\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.225266 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.225231 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:47.228404 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.228382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57dqx\" (UniqueName: \"kubernetes.io/projected/d76facb4-1f7d-4eb7-9368-99168ab2771d-kube-api-access-57dqx\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.228477 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.228425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d76facb4-1f7d-4eb7-9368-99168ab2771d-must-gather-output\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.228744 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.228725 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d76facb4-1f7d-4eb7-9368-99168ab2771d-must-gather-output\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.243450 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.243426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57dqx\" (UniqueName: \"kubernetes.io/projected/d76facb4-1f7d-4eb7-9368-99168ab2771d-kube-api-access-57dqx\") pod \"must-gather-lrsjf\" (UID: \"d76facb4-1f7d-4eb7-9368-99168ab2771d\") " pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.310573 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.310493 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:01:47.361043 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.361003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" Jul 21 07:01:47.492226 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.492201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/must-gather-lrsjf"] Jul 21 07:01:47.494327 ip-10-0-136-215 kubenswrapper[2572]: W0721 07:01:47.494299 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd76facb4_1f7d_4eb7_9368_99168ab2771d.slice/crio-fd910246c84481c782a224ef485f38f51fe96131be06e00e193bef8690883db8 WatchSource:0}: Error finding container fd910246c84481c782a224ef485f38f51fe96131be06e00e193bef8690883db8: Status 404 returned error can't find the container with id fd910246c84481c782a224ef485f38f51fe96131be06e00e193bef8690883db8 Jul 21 07:01:47.496265 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:47.496244 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 07:01:48.325714 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:48.325683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" event={"ID":"d76facb4-1f7d-4eb7-9368-99168ab2771d","Type":"ContainerStarted","Data":"fd910246c84481c782a224ef485f38f51fe96131be06e00e193bef8690883db8"} Jul 21 07:01:49.333610 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:49.333576 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" event={"ID":"d76facb4-1f7d-4eb7-9368-99168ab2771d","Type":"ContainerStarted","Data":"3abb92ce37d79dc0f1671fd5aa5a4a4a2594684aec1be43ae1a944ddc2e36b96"} Jul 21 07:01:49.334173 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:49.333625 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" event={"ID":"d76facb4-1f7d-4eb7-9368-99168ab2771d","Type":"ContainerStarted","Data":"6c1133e1b24b94db19cffd9b4786bbe206d294377785a57a5079fa53cd998122"} Jul 21 07:01:49.353979 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:49.353916 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mtl9f/must-gather-lrsjf" podStartSLOduration=1.555471711 podStartE2EDuration="2.3539001s" totalImagesPullingTime="798.428389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:01:49.351152197 +0000 UTC m=+2647.931933392" watchObservedRunningTime="2026-07-21 07:01:49.3539001 +0000 UTC m=+2647.934681327" Jul 21 07:01:49.949532 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:49.949503 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vvzgb_ab1b08d3-6c1d-4626-b8c3-f9b516f28bb7/global-pull-secret-syncer/0.log" Jul 21 07:01:50.006980 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:50.006941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" Jul 21 07:01:50.117212 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:50.117165 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-215.ec2.internal_f7c5f08313d5b925e981af86d9cc424a/haproxy/0.log" Jul 21 07:01:55.486218 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:55.485693 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-74f6ddbb8d-zndvf_092a4d05-337e-4ad4-a87b-2852c0cf12f8/authorino/0.log" Jul 21 07:01:55.786936 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:55.786892 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5fn7h_1e28ad52-0398-4812-b6ea-6e7ba13ffae1/limitador/0.log" Jul 21 07:01:58.204701 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:58.204665 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vsbbr_e2e52f7d-f6d9-4cec-8f4e-160504c31bf2/node-exporter/0.log" Jul 21 07:01:58.229944 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:58.229914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vsbbr_e2e52f7d-f6d9-4cec-8f4e-160504c31bf2/kube-rbac-proxy/0.log" Jul 21 07:01:58.260522 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:58.260493 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vsbbr_e2e52f7d-f6d9-4cec-8f4e-160504c31bf2/init-textfile/0.log" Jul 21 07:01:59.917657 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:01:59.917626 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-22pv6_b0a6ff90-3814-4b93-a2f7-99150297df4a/networking-console-plugin/0.log" Jul 21 07:02:00.440325 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.440287 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv"] Jul 21 07:02:00.449209 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.449175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.451989 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.451870 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv"] Jul 21 07:02:00.551213 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.551164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-proc\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.551497 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.551478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-podres\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.551659 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.551642 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwrcj\" (UniqueName: \"kubernetes.io/projected/74fef863-f524-4348-9411-ff3a2ec08b9e-kube-api-access-vwrcj\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.551778 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.551767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-lib-modules\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.551897 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.551885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-sys\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.555974 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.555950 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/1.log" Jul 21 07:02:00.570090 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.569234 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-28snx_453673c2-aa85-4a01-bca6-76a5918ef8f1/console-operator/2.log" Jul 21 07:02:00.653416 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-lib-modules\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653617 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-sys\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653700 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-proc\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653758 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653683 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-lib-modules\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653758 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653726 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-proc\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653758 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-podres\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653899 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653794 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-podres\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653899 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653682 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74fef863-f524-4348-9411-ff3a2ec08b9e-sys\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.653899 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.653813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwrcj\" (UniqueName: \"kubernetes.io/projected/74fef863-f524-4348-9411-ff3a2ec08b9e-kube-api-access-vwrcj\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.663252 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.663219 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwrcj\" (UniqueName: \"kubernetes.io/projected/74fef863-f524-4348-9411-ff3a2ec08b9e-kube-api-access-vwrcj\") pod \"perf-node-gather-daemonset-55qkv\" (UID: \"74fef863-f524-4348-9411-ff3a2ec08b9e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.770341 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.770308 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:00.959467 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:00.959433 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv"] Jul 21 07:02:01.424570 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:01.424485 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" event={"ID":"74fef863-f524-4348-9411-ff3a2ec08b9e","Type":"ContainerStarted","Data":"54eac043218adbae806e524be2b3548dfcbdaa2bd3037a3f4ef31b3bc62ca676"} Jul 21 07:02:01.424570 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:01.424536 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" event={"ID":"74fef863-f524-4348-9411-ff3a2ec08b9e","Type":"ContainerStarted","Data":"bac5f94078636e773aeab45312de939256baadd9decde74e08254049e34a0a28"} Jul 21 07:02:01.424570 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:01.424568 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:01.444052 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:01.443990 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" podStartSLOduration=1.4439668399999999 podStartE2EDuration="1.44396684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:02:01.441860223 +0000 UTC m=+2660.022641418" watchObservedRunningTime="2026-07-21 07:02:01.44396684 +0000 UTC m=+2660.024748035" Jul 21 07:02:01.799015 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:01.798989 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-kpflq_ed8aa00d-6bf0-494e-84ca-931f86b9abc6/volume-data-source-validator/0.log" Jul 21 07:02:02.850637 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:02.850610 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zdrr_65e18821-e28d-4411-ac15-0fbd04ce5b95/dns/0.log" Jul 21 07:02:02.870220 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:02.870192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5zdrr_65e18821-e28d-4411-ac15-0fbd04ce5b95/kube-rbac-proxy/0.log" Jul 21 07:02:02.983401 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:02.983373 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lcvbx_e3d17367-f5b8-49d2-9468-84cb73ea78db/dns-node-resolver/0.log" Jul 21 07:02:03.578908 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:03.578870 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pv2mz_bd536a99-1717-4e99-b2df-4127807bcb27/node-ca/0.log" Jul 21 07:02:04.647793 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:04.647766 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff9c87565-m2n2q_6f6215e1-a3f6-4a88-ad0c-55aeccde246e/kube-auth-proxy/0.log" Jul 21 07:02:05.534589 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:05.534549 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7tfkp_a43a9b77-6779-4dba-925c-c59e1e49e0ef/serve-healthcheck-canary/0.log" Jul 21 07:02:06.113003 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:06.112977 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stvsz_b1c7b12f-9a35-4570-9156-82f89a62f52c/kube-rbac-proxy/0.log" Jul 21 07:02:06.132408 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:06.132318 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stvsz_b1c7b12f-9a35-4570-9156-82f89a62f52c/exporter/0.log" Jul 21 07:02:06.151559 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:06.151519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stvsz_b1c7b12f-9a35-4570-9156-82f89a62f52c/extractor/0.log" Jul 21 07:02:07.442715 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:07.442683 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-55qkv" Jul 21 07:02:09.072726 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:09.072692 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-hjg9r_5cf6e4fb-863c-4b4f-ad91-c97e33b31c38/manager/0.log" Jul 21 07:02:09.093819 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:09.093794 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-hjg9r_5cf6e4fb-863c-4b4f-ad91-c97e33b31c38/copy-manifests/0.log" Jul 21 07:02:10.477797 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:10.477586 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-964495ff5-tnn52_b29ba0f1-0603-4a29-bf02-1f09a525f83c/manager/0.log" Jul 21 07:02:11.082474 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:11.082442 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff9c87565-m2n2q_6f6215e1-a3f6-4a88-ad0c-55aeccde246e/kube-auth-proxy/0.log" Jul 21 07:02:12.554500 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:12.554472 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff9c87565-m2n2q_6f6215e1-a3f6-4a88-ad0c-55aeccde246e/kube-auth-proxy/0.log" Jul 21 07:02:15.336508 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:15.336474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:02:15.435413 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:15.435379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5gnxm_6149349e-ba6d-4171-bb14-992eb1916b1e/konnectivity-agent/0.log" limit=1024 Jul 21 07:02:15.906163 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:15.906106 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-t29dg_70f9c31b-a808-449e-a2ee-dc4d44f9f3b1/kube-storage-version-migrator-operator/1.log" Jul 21 07:02:15.907196 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:15.907172 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-t29dg_70f9c31b-a808-449e-a2ee-dc4d44f9f3b1/kube-storage-version-migrator-operator/0.log" Jul 21 07:02:16.891286 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:16.891251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2td7f_d6d0eb93-3794-4ae0-8ae2-db985ce71001/kube-multus/0.log" Jul 21 07:02:17.256303 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.256236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/kube-multus-additional-cni-plugins/0.log" Jul 21 07:02:17.277723 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.277695 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/egress-router-binary-copy/0.log" Jul 21 07:02:17.298959 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.298932 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/cni-plugins/0.log" Jul 21 07:02:17.320851 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.320826 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/bond-cni-plugin/0.log" Jul 21 07:02:17.342400 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.342374 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/routeoverride-cni/0.log" Jul 21 07:02:17.362276 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.362249 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/whereabouts-cni-bincopy/0.log" Jul 21 07:02:17.381628 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.381605 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5h5p_26b5216b-a3ca-44e6-9c99-1ddb9e584b59/whereabouts-cni/0.log" Jul 21 07:02:17.534544 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.534514 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vmpc6_984533da-66c0-4ed2-b59c-7258adfb3890/network-metrics-daemon/0.log" Jul 21 07:02:17.553814 ip-10-0-136-215 kubenswrapper[2572]: I0721 07:02:17.553788 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vmpc6_984533da-66c0-4ed2-b59c-7258adfb3890/kube-rbac-proxy/0.log"