Jul 15 22:16:24.625309 ip-10-0-139-92 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.077870    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083282    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083293    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083296    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083299    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083302    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083305    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083308    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.144550 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083311    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083315    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083319    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083322    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083334    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083337    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083339    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083342    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083345    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083348    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083351    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083353    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083355    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083358    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083361    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083364    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083367    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083370    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083373    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.145431 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083376    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083380    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083383    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083386    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083388    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083391    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083394    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083396    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083399    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083401    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083404    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083406    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083409    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083411    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083413    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083416    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083418    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083421    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083424    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083427    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.146340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083430    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083432    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083435    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083438    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083441    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083444    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083446    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083449    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083452    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083454    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083457    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083460    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083462    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083465    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083469    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083472    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083475    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083478    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083481    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083484    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.146982 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083486    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083489    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083491    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083494    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083497    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083499    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083502    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083505    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083507    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083510    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083513    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083521    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083524    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083526    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083529    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083532    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083535    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083538    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083540    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083543    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.147614 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083546    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083548    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083551    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083554    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083556    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083559    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083561    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083564    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083566    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083569    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083573    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083576    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.083578    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084718    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084737    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084743    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084751    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084757    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084763    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.148258 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084773    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084779    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084783    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084788    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084792    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084797    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084801    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084805    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084810    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084814    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084818    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084823    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084833    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084837    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084841    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084846    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084850    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084854    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084858    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084862    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.148887 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084866    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084870    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084874    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084878    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084883    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084892    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084897    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084903    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084907    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084912    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084918    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084922    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084926    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084930    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084935    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084939    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084943    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084952    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084956    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084960    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.149506 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084965    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084969    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084973    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084977    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084981    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084985    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084989    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084993    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.084997    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085001    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085026    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085030    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085047    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085051    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085056    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085060    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085064    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085069    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085073    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.150135 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085077    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085082    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085087    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085097    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085101    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085105    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085109    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085114    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085117    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085122    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085126    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085130    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085134    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085141    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085145    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085182    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085197    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085202    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085213    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085237    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.150763 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085248    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085386    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085393    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085397    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085400    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085403    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085406    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085409    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085412    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085415    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085419    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085422    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085425    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085429    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085832    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085838    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085841    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085844    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085848    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.151403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085850    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085853    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085856    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085859    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085861    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085864    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085868    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085871    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085874    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085877    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085881    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085883    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085886    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085888    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085891    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085894    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085897    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085900    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085903    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.152261 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085905    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085908    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085910    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085913    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085915    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085918    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085920    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085923    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085925    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085928    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085930    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085933    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085936    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085938    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085941    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085943    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085946    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085948    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085951    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085953    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.152811 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085957    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085960    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085962    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085965    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085968    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085972    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085975    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085978    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085981    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085984    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085987    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085989    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085992    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085995    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.085998    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086001    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086004    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086007    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086026    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086030    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.153428 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086034    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086038    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086041    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086045    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086048    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086051    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086053    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086056    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086059    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086063    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086066    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086069    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086073    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086076    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086079    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086082    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086085    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086087    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086090    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086093    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.156273 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086096    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086099    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086102    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086105    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086108    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086111    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086114    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086116    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086119    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086122    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086124    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086127    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086129    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086132    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086134    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086204    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086212    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086223    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086230    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086236    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086240    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 22:16:25.156852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086244    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 22:16:25.157311 ip-10-0-139-92 systemd[1]: Started Kubernetes Kubelet.
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086248    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086252    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086255    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086258    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086261    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086264    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086267    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086270    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086273    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086277    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086281    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086286    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086288    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086291    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086294    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086298    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086309    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086311    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086315    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086318    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086321    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086325    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086327    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 22:16:25.158542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086331    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086333    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086337    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086344    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086347    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086349    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086352    2565 flags.go:64] FLAG: --enable-server="true"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086356    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086360    2565 flags.go:64] FLAG: --event-burst="100"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086363    2565 flags.go:64] FLAG: --event-qps="50"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086366    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086369    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086372    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086376    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086379    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086381    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086384    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086387    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086390    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086393    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086396    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086399    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086402    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086405    2565 flags.go:64] FLAG: --feature-gates=""
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086408    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 22:16:25.159721 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086411    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086414    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086417    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086420    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086424    2565 flags.go:64] FLAG: --help="false"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086426    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086429    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086432    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086435    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086438    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086443    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086447    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086449    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086452    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086455    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086458    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086461    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086464    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086467    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086470    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086473    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086476    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086479    2565 flags.go:64] FLAG: --lock-file=""
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086482    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 22:16:25.161129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086485    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086488    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086494    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086498    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086501    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086504    2565 flags.go:64] FLAG: --logging-format="text"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086507    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086510    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086513    2565 flags.go:64] FLAG: --manifest-url=""
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086516    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086520    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086523    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086527    2565 flags.go:64] FLAG: --max-pods="110"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086530    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086533    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086536    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086538    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086542    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086546    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086549    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086556    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086559    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086562    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 22:16:25.162038 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086565    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086568    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086573    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086576    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086579    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086582    2565 flags.go:64] FLAG: --port="10250"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086585    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086588    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0802ef85964638f47"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086591    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086594    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086597    2565 flags.go:64] FLAG: --register-node="true"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086600    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086605    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086608    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086611    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086614    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086618    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086621    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086624    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086627    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086629    2565 flags.go:64] FLAG: --runonce="false"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086633    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086635    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086638    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086641    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 22:16:25.325262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086644    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086647    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086650    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086655    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086659    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086662    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086665    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086668    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086671    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086674    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086676    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086682    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086684    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086687    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086691    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086694    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086697    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086699    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086702    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086706    2565 flags.go:64] FLAG: --v="2"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086710    2565 flags.go:64] FLAG: --version="false"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086715    2565 flags.go:64] FLAG: --vmodule=""
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086719    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.086722    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086840    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.326284 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086845    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086848    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086853    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086856    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086859    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086862    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086865    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086868    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086871    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086874    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086878    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086881    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086884    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086887    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086889    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086892    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086894    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086897    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086899    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.327694 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086903    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086907    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086910    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086913    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086916    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086918    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086921    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086927    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086929    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086933    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086936    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086939    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086941    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086944    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086947    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086950    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086952    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086955    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086958    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.328490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086961    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086963    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086965    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086968    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086972    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086974    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086977    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086980    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086983    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086985    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086988    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086990    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086993    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086995    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.086997    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087000    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087002    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087005    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087007    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087026    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.329579 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087032    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087034    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087037    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087040    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087043    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087045    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087048    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087051    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087054    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087056    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087059    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087061    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087064    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087066    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087069    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087072    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087076    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087078    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087081    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087083    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.332269 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087086    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087089    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087092    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087094    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087097    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087099    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087102    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087104    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087107    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087109    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087112    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087114    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087118    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087121    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087123    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087126    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087128    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087131    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087134    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.332915 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.087137    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.087770    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.095205    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.095221    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.096190    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.096200    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096276    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096281    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096284    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096288    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096291    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096294    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096297    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096300    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096303    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.333528 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096306    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096308    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096311    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096314    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096317    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096320    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096322    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096325    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096328    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096331    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096334    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096336    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096339    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096342    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096345    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096347    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096350    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096352    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096355    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.334082 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096358    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096361    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096364    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096367    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096369    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096372    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096374    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096377    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096383    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096386    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096389    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096391    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096394    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096396    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096399    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096402    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096404    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096407    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096409    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096412    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.334630 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096414    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096417    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096419    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096422    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096424    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096427    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096429    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096432    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096435    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096438    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096440    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096443    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096445    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096448    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096451    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096459    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096462    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096464    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096467    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096469    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.335237 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096476    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096479    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096482    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096485    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096488    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096491    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096494    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096497    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096500    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096502    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096505    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096508    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096510    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096513    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096515    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096517    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096520    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096522    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096525    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096527    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.335958 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096530    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096532    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096535    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096538    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096540    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096543    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096547    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096553    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096555    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096558    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096562    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.096567    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096679    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096684    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 22:16:25.336538 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096687    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096691    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096694    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096696    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096699    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096702    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096705    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096708    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096711    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096713    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096716    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096719    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096721    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096724    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096726    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096729    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096731    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096734    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096736    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096739    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 22:16:25.337091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096742    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096744    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096747    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096749    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096752    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096756    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096759    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096761    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096764    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096766    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096769    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096773    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096776    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096778    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096781    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096784    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096788    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096791    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096794    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 22:16:25.337687 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096797    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096799    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096802    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096805    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096808    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096811    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096813    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096817    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096820    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096824    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096827    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096829    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096832    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096835    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096838    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096840    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096843    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096845    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096849    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 22:16:25.338332 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096852    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096855    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096857    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096860    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096862    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096867    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096870    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096873    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096875    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096878    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096880    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096884    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096888    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096891    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096893    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096896    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096898    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096901    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096903    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096906    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 22:16:25.338899 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096908    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096911    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096913    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096916    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096918    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096921    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096923    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096925    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096928    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096931    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096933    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096936    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096939    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096941    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096944    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096947    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096950    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096954    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 22:16:25.339454 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:25.096956    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.096961    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.097105    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.099287    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.100561    2565 server.go:1019] "Starting client certificate rotation"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.100660    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.100704    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.102879    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.103994    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.122163    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.124529    2565 log.go:25] "Validated CRI v1 image API"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.125269    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 22:16:25.522736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.129551    2565 fs.go:135] Filesystem UUIDs: map[252427e6-8f90-47b9-8e47-56a56915f075:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b3d30290-4b8f-4000-9927-a544cd84e0db:/dev/nvme0n1p3]
Jul 15 22:16:25.524033 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.129567    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.134210    2565 manager.go:216] Machine: {Timestamp:2026-07-15 22:16:25.133723402 +0000 UTC m=+0.373641152 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3207366 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2170c0916747ef355d3f1939165ceb SystemUUID:ec2170c0-9167-47ef-355d-3f1939165ceb BootID:7b5912d1-395e-446a-ab19-70afc381ee83 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4c:f9:6c:c5:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4c:f9:6c:c5:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:55:28:55:11:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.134309    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.134411    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.137553    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.137586    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.138388    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.138400    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 22:16:25.524251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.138411    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.138425    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.139701    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.139918    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143254    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143382    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143408    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143419    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143434    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143443    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143457    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143758    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.143775    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.147541    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149439    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149468    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149604    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149632    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149639    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149645    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149655    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.149660    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150216    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150223    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150230    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150236    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150245    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.150253    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.151376    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.151383    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.156590    2565 server.go:1268] "Started kubelet"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.156959    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.158933    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.162644    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.162699    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.162793    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g7wxn"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.164529    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.167101    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.167148    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 22:16:25.524697 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.167247    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.168225    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.168250    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.168394    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.168929    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169041    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169045    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169067    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169117    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169126    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169205    2565 factory.go:55] Registering systemd factory
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169216    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169769    2565 factory.go:153] Registering CRI-O factory
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169782    2565 factory.go:223] Registration of the crio container factory successfully
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169829    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169853    2565 factory.go:103] Registering Raw factory
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.169869    2565 manager.go:1196] Started watching for new ooms in manager
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.170198    2565 manager.go:349] Starting recovery of all containers
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.173316    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g7wxn"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.179194    2565 manager.go:354] Recovery completed
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.179677    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.182830    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-92.ec2.internal\" not found" node="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.183852    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.186555    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.186580    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.186592    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.187136    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.187146    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.187150    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.187172    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188163    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188184    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188196    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188517    2565 policy_none.go:49] "None policy: Start"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188529    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.188539    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.189671    2565 policy_none.go:47] "Start"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213043    2565 manager.go:337] "Starting Device Plugin manager"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.213092    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213103    2565 server.go:87] "Starting device plugin registration server"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213320    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213329    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213430    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213505    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 22:16:25.525999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.213514    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.213954    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.214027    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.314307    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.315849    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.315876    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.315890    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.315915    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.326380    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.326398    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-92.ec2.internal\": node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.342167    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.349139    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.350212    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.350251    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.350272    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.350300    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.352419    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.445567    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.451126    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"]
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.451231    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.452304    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.452332    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.452342    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.453862    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.453987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454020    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454665    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454695    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454708    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454715    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454734    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.454744    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.456225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.456249    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 22:16:25.527293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.461753    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 22:16:25.528306 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.461787    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 22:16:25.528306 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.461809    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeHasSufficientPID"
Jul 15 22:16:25.528306 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.490829    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-92.ec2.internal\" not found" node="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.528306 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.497547    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-92.ec2.internal\" not found" node="ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.546276    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.570510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd167fdd0eb6d8c7e13b6472e5a2db0d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-92.ec2.internal\" (UID: \"fd167fdd0eb6d8c7e13b6472e5a2db0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.570531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.570549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.647948    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.670839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.670869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.670889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd167fdd0eb6d8c7e13b6472e5a2db0d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-92.ec2.internal\" (UID: \"fd167fdd0eb6d8c7e13b6472e5a2db0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.670953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.670984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5f6e207d96a71851e261e8217ed6731-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal\" (UID: \"b5f6e207d96a71851e261e8217ed6731\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.723939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.671054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fd167fdd0eb6d8c7e13b6472e5a2db0d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-92.ec2.internal\" (UID: \"fd167fdd0eb6d8c7e13b6472e5a2db0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.900049 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.748793    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:25.900049 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.793503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.900049 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:25.800963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:25.900049 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.849558    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:26.093759 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:25.952141    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:26.093759 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:26.053746    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.099666    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.099812    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.099834    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:26.153983    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.177690    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 22:11:25 +0000 UTC" deadline="2028-04-09 23:20:18.799390846 +0000 UTC"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.177712    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15217h3m52.621681625s"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:26.254902    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-92.ec2.internal\" not found"
Jul 15 22:16:26.336510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.293068    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.369037    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.379725    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.382134    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.392829    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:26.538498    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f6e207d96a71851e261e8217ed6731.slice/crio-11f5c7be30314da2d3f16210144e64f00b5e73c070798d0211037ffcdfce17d8 WatchSource:0}: Error finding container 11f5c7be30314da2d3f16210144e64f00b5e73c070798d0211037ffcdfce17d8: Status 404 returned error can't find the container with id 11f5c7be30314da2d3f16210144e64f00b5e73c070798d0211037ffcdfce17d8
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.540363    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:26.551865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:26.544806    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:16:26.792640 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:26.581920    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd167fdd0eb6d8c7e13b6472e5a2db0d.slice/crio-1542f19b71039732341fe36c78568dfecea9b5cba85903fb00e7653489381879 WatchSource:0}: Error finding container 1542f19b71039732341fe36c78568dfecea9b5cba85903fb00e7653489381879: Status 404 returned error can't find the container with id 1542f19b71039732341fe36c78568dfecea9b5cba85903fb00e7653489381879
Jul 15 22:16:27.147969 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.147937    2565 apiserver.go:52] "Watching apiserver"
Jul 15 22:16:27.156907 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.156876    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 22:16:27.159525 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.159495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-m45qq","openshift-multus/network-metrics-daemon-6c8dc","openshift-network-diagnostics/network-check-target-2ncf8","openshift-network-operator/iptables-alerter-hkskg","openshift-ovn-kubernetes/ovnkube-node-cw62k","kube-system/global-pull-secret-syncer-k4n6n","kube-system/konnectivity-agent-4xthk","kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd","openshift-cluster-node-tuning-operator/tuned-z9jxh","openshift-dns/node-resolver-kst97","openshift-image-registry/node-ca-mkr2m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal","openshift-multus/multus-additional-cni-plugins-znc7r"]
Jul 15 22:16:27.161522 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.161497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.164035 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.164010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.164261 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.164246    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.164349 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.164325    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:27.164414 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.164349    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.165208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.164919    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 22:16:27.165305 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.165216    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95zp2\""
Jul 15 22:16:27.165498 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.165466    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 22:16:27.165755 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.165735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:27.165854 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.165823    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:27.168001 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.167983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.168431 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.168414    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 22:16:27.170458 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.170439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.171421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.171393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.171545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.171524    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.171670 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.171630    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 22:16:27.171909 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.171858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7fs2r\""
Jul 15 22:16:27.174948 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.174930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.175062 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.174996    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:27.177690 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.177670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.180605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.180300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.181621 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.181606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.183174 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.183465 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-system-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.183546 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-multus\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.183546 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-kubelet\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.183650 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:27.183650 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-ovn\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.183650 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsl44\" (UniqueName: \"kubernetes.io/projected/53b39ae8-2f26-43a1-b878-1c2ce7604556-kube-api-access-dsl44\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-systemd-units\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17d3892b-ef76-4653-b740-976c3ef55158-ovn-node-metrics-cert\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-cni-binary-copy\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-slash\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-netns\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.183802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-var-lib-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-etc-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-log-socket\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-kubelet\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-os-release\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-k8s-cni-cncf-io\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-netns\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.183984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-multus-certs\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.184066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30cc122d-290e-450a-825c-e6d80e6169ee-host-slash\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.184581 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-node-log\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.184819 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-etc-kubernetes\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.184892 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m68xz\" (UniqueName: \"kubernetes.io/projected/7c541bf9-c370-4af5-a454-1755a1903793-kube-api-access-m68xz\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.184892 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.184881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-bin\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185529 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-env-overrides\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185599 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-script-lib\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185659 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khfcp\" (UniqueName: \"kubernetes.io/projected/17d3892b-ef76-4653-b740-976c3ef55158-kube-api-access-khfcp\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185659 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-daemon-config\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.185756 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30cc122d-290e-450a-825c-e6d80e6169ee-iptables-alerter-script\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.185756 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-systemd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.185954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-socket-dir-parent\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.185954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.185923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-bin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.186892 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.186776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.187406 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.187380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rhsbb\""
Jul 15 22:16:27.187606 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.187581    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 22:16:27.188869 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.187936    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.188993 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.188966    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.189057 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.188497    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 22:16:27.189471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.188484    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 22:16:27.189471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.189359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.189727 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.189701    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 22:16:27.189836 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.189816    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.190049 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190008    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.190049 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190026    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.190203 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qdlvw\""
Jul 15 22:16:27.190203 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190137    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 22:16:27.190350 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190309    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-hostroot\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.190438 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.190374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-conf-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvcg9\" (UniqueName: \"kubernetes.io/projected/30cc122d-290e-450a-825c-e6d80e6169ee-kube-api-access-zvcg9\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-config\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-cnibin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-netd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.191815    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192762    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192816    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grdd6\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.192969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.193000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbh58\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.193090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4rkv5\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.193122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.193164    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.193238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h4vlc\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.195706    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.195820    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.196133    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94vtx\""
Jul 15 22:16:27.197545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.196311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 22:16:27.212065 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.212041    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mjdj5"
Jul 15 22:16:27.227143 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.227125    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mjdj5"
Jul 15 22:16:27.269872 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.269847    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 22:16:27.292071 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khfcp\" (UniqueName: \"kubernetes.io/projected/17d3892b-ef76-4653-b740-976c3ef55158-kube-api-access-khfcp\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.292194 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-etc-kubernetes\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.292194 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m68xz\" (UniqueName: \"kubernetes.io/projected/7c541bf9-c370-4af5-a454-1755a1903793-kube-api-access-m68xz\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.292194 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-etc-kubernetes\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.292372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.292372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-lib-modules\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.292372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-host\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.292372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4168e9-5194-49cc-87d2-d58a8a57fa65-tmp-dir\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.292372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-system-cni-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292363    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-os-release\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-systemd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-agent-certs\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-konnectivity-ca\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-systemd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8762t\" (UniqueName: \"kubernetes.io/projected/5657d75b-16ef-4000-b99e-a0037d3a95a9-kube-api-access-8762t\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.292617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-socket-dir-parent\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvcg9\" (UniqueName: \"kubernetes.io/projected/30cc122d-290e-450a-825c-e6d80e6169ee-kube-api-access-zvcg9\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-run\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-socket-dir-parent\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-device-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-sys-fs\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nstkg\" (UniqueName: \"kubernetes.io/projected/4c4168e9-5194-49cc-87d2-d58a8a57fa65-kube-api-access-nstkg\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysconfig\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.293002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.292996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8f6p\" (UniqueName: \"kubernetes.io/projected/06ad9a55-da1d-4e05-a578-940a69e21008-kube-api-access-x8f6p\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsl44\" (UniqueName: \"kubernetes.io/projected/53b39ae8-2f26-43a1-b878-1c2ce7604556-kube-api-access-dsl44\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17d3892b-ef76-4653-b740-976c3ef55158-ovn-node-metrics-cert\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/975b931e-273b-4022-b8b1-5a966b02d870-host\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-cni-binary-copy\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-slash\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-var-lib-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-etc-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-log-socket\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-systemd\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-dbus\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.293528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-slash\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-netns\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-netns\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-var-lib-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-etc-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293613    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293665    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-log-socket\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.293946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-multus-certs\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.294034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30cc122d-290e-450a-825c-e6d80e6169ee-host-slash\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-env-overrides\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-socket-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c4168e9-5194-49cc-87d2-d58a8a57fa65-hosts-file\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-cni-binary-copy\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-daemon-config\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30cc122d-290e-450a-825c-e6d80e6169ee-iptables-alerter-script\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-kubernetes\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-sys\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.294491 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-bin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-hostroot\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-conf-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-config\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-cnibin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-netd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-modprobe-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-var-lib-kubelet\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-tmp\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-registration-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwzp\" (UniqueName: \"kubernetes.io/projected/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-kube-api-access-ktwzp\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-system-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-multus\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-kubelet\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30cc122d-290e-450a-825c-e6d80e6169ee-iptables-alerter-script\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-ovn\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-conf\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/975b931e-273b-4022-b8b1-5a966b02d870-serviceca\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.294992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-systemd-units\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-etc-tuned\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-kubelet-config\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cnibin\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30cc122d-290e-450a-825c-e6d80e6169ee-host-slash\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-netns\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwh6q\" (UniqueName: \"kubernetes.io/projected/975b931e-273b-4022-b8b1-5a966b02d870-kube-api-access-lwh6q\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-kubelet\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-os-release\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.295737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-k8s-cni-cncf-io\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-node-log\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-bin\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-script-lib\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-daemon-config\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-env-overrides\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-multus-certs\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-openvswitch\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-cnibin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-bin\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-hostroot\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.295935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-conf-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-script-lib\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.296451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-netd\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-system-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-cni-multus\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296466    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-var-lib-kubelet\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/17d3892b-ef76-4653-b740-976c3ef55158-ovnkube-config\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-run-ovn\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-systemd-units\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-multus-cni-dir\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-run-netns\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-host-run-k8s-cni-cncf-io\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53b39ae8-2f26-43a1-b878-1c2ce7604556-os-release\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-node-log\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-cni-bin\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.296843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/17d3892b-ef76-4653-b740-976c3ef55158-host-kubelet\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.296891    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:27.297273 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.296954    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.796930597 +0000 UTC m=+3.036848340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:27.300261 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.300215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/17d3892b-ef76-4653-b740-976c3ef55158-ovn-node-metrics-cert\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.303571 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.303511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khfcp\" (UniqueName: \"kubernetes.io/projected/17d3892b-ef76-4653-b740-976c3ef55158-kube-api-access-khfcp\") pod \"ovnkube-node-cw62k\" (UID: \"17d3892b-ef76-4653-b740-976c3ef55158\") " pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.303696 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.303670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m68xz\" (UniqueName: \"kubernetes.io/projected/7c541bf9-c370-4af5-a454-1755a1903793-kube-api-access-m68xz\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.304378 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.304357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvcg9\" (UniqueName: \"kubernetes.io/projected/30cc122d-290e-450a-825c-e6d80e6169ee-kube-api-access-zvcg9\") pod \"iptables-alerter-hkskg\" (UID: \"30cc122d-290e-450a-825c-e6d80e6169ee\") " pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.305033 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.304975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsl44\" (UniqueName: \"kubernetes.io/projected/53b39ae8-2f26-43a1-b878-1c2ce7604556-kube-api-access-dsl44\") pod \"multus-m45qq\" (UID: \"53b39ae8-2f26-43a1-b878-1c2ce7604556\") " pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.305166 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.305049    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:27.305166 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.305076    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:27.305166 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.305107    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:27.305319 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.305172    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.805154347 +0000 UTC m=+3.045072102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:27.360245 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.360186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal" event={"ID":"fd167fdd0eb6d8c7e13b6472e5a2db0d","Type":"ContainerStarted","Data":"1542f19b71039732341fe36c78568dfecea9b5cba85903fb00e7653489381879"}
Jul 15 22:16:27.362221 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.362193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal" event={"ID":"b5f6e207d96a71851e261e8217ed6731","Type":"ContainerStarted","Data":"11f5c7be30314da2d3f16210144e64f00b5e73c070798d0211037ffcdfce17d8"}
Jul 15 22:16:27.385572 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.385520    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:27.396218 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396194    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-conf\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/975b931e-273b-4022-b8b1-5a966b02d870-serviceca\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.396334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-etc-tuned\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-kubelet-config\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.396334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cnibin\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwh6q\" (UniqueName: \"kubernetes.io/projected/975b931e-273b-4022-b8b1-5a966b02d870-kube-api-access-lwh6q\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396394    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-lib-modules\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-host\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4168e9-5194-49cc-87d2-d58a8a57fa65-tmp-dir\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-system-cni-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-os-release\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-agent-certs\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.396510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-konnectivity-ca\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8762t\" (UniqueName: \"kubernetes.io/projected/5657d75b-16ef-4000-b99e-a0037d3a95a9-kube-api-access-8762t\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-run\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-device-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-sys-fs\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nstkg\" (UniqueName: \"kubernetes.io/projected/4c4168e9-5194-49cc-87d2-d58a8a57fa65-kube-api-access-nstkg\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysconfig\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-kubelet-config\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8f6p\" (UniqueName: \"kubernetes.io/projected/06ad9a55-da1d-4e05-a578-940a69e21008-kube-api-access-x8f6p\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cnibin\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.396847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/975b931e-273b-4022-b8b1-5a966b02d870-host\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-systemd\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396941    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-dbus\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-socket-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/975b931e-273b-4022-b8b1-5a966b02d870-host\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.396998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c4168e9-5194-49cc-87d2-d58a8a57fa65-hosts-file\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-kubernetes\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-sys\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-lib-modules\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-modprobe-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.397432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4168e9-5194-49cc-87d2-d58a8a57fa65-tmp-dir\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-var-lib-kubelet\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-tmp\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-registration-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysctl-conf\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwzp\" (UniqueName: \"kubernetes.io/projected/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-kube-api-access-ktwzp\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-os-release\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-sys\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-host\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-run\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-systemd\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.397641    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-sys-fs\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.398156 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.397692    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.897678398 +0000 UTC m=+3.137596149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/975b931e-273b-4022-b8b1-5a966b02d870-serviceca\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397803    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-registration-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-konnectivity-ca\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ab3acd4-df38-4b05-8122-a00be2caeefd-dbus\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-system-cni-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c4168e9-5194-49cc-87d2-d58a8a57fa65-hosts-file\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-modprobe-d\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.397941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-socket-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-sysconfig\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-etc-kubernetes\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06ad9a55-da1d-4e05-a578-940a69e21008-var-lib-kubelet\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.398767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5657d75b-16ef-4000-b99e-a0037d3a95a9-device-dir\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.399455 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.399455 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.398500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.399566 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.399467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-etc-tuned\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.400717 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.400694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06ad9a55-da1d-4e05-a578-940a69e21008-tmp\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.402487 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.402439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4358b9e3-6422-4dd8-b06a-c8ca5eaf593b-agent-certs\") pod \"konnectivity-agent-4xthk\" (UID: \"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b\") " pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.409781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.409745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwh6q\" (UniqueName: \"kubernetes.io/projected/975b931e-273b-4022-b8b1-5a966b02d870-kube-api-access-lwh6q\") pod \"node-ca-mkr2m\" (UID: \"975b931e-273b-4022-b8b1-5a966b02d870\") " pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.410815 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.410794    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8762t\" (UniqueName: \"kubernetes.io/projected/5657d75b-16ef-4000-b99e-a0037d3a95a9-kube-api-access-8762t\") pod \"aws-ebs-csi-driver-node-z2pkd\" (UID: \"5657d75b-16ef-4000-b99e-a0037d3a95a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.412384 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.412360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwzp\" (UniqueName: \"kubernetes.io/projected/b067aaff-5ccf-4e4c-84d4-f45517e6aa6a-kube-api-access-ktwzp\") pod \"multus-additional-cni-plugins-znc7r\" (UID: \"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a\") " pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.412870 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.412844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8f6p\" (UniqueName: \"kubernetes.io/projected/06ad9a55-da1d-4e05-a578-940a69e21008-kube-api-access-x8f6p\") pod \"tuned-z9jxh\" (UID: \"06ad9a55-da1d-4e05-a578-940a69e21008\") " pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.413479 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.413391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nstkg\" (UniqueName: \"kubernetes.io/projected/4c4168e9-5194-49cc-87d2-d58a8a57fa65-kube-api-access-nstkg\") pod \"node-resolver-kst97\" (UID: \"4c4168e9-5194-49cc-87d2-d58a8a57fa65\") " pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.477128 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.477094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m45qq"
Jul 15 22:16:27.489520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.489500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkskg"
Jul 15 22:16:27.490530 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:27.490498    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b39ae8_2f26_43a1_b878_1c2ce7604556.slice/crio-ca245e5bec813a2120ebce91c749a00abb0c1080475becbfa0af8e07cf0d0bec WatchSource:0}: Error finding container ca245e5bec813a2120ebce91c749a00abb0c1080475becbfa0af8e07cf0d0bec: Status 404 returned error can't find the container with id ca245e5bec813a2120ebce91c749a00abb0c1080475becbfa0af8e07cf0d0bec
Jul 15 22:16:27.498938 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:27.498909    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cc122d_290e_450a_825c_e6d80e6169ee.slice/crio-938d9583adb7762f7dbacf69c4c426032f4b1d780912c7f031e2f76699b42888 WatchSource:0}: Error finding container 938d9583adb7762f7dbacf69c4c426032f4b1d780912c7f031e2f76699b42888: Status 404 returned error can't find the container with id 938d9583adb7762f7dbacf69c4c426032f4b1d780912c7f031e2f76699b42888
Jul 15 22:16:27.502884 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.502827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:27.511139 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.511108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:27.511724 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:27.511700    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d3892b_ef76_4653_b740_976c3ef55158.slice/crio-fbca16bc308eb61bc98f28d8392158c2482997066dd91549cf848d218ea1c8da WatchSource:0}: Error finding container fbca16bc308eb61bc98f28d8392158c2482997066dd91549cf848d218ea1c8da: Status 404 returned error can't find the container with id fbca16bc308eb61bc98f28d8392158c2482997066dd91549cf848d218ea1c8da
Jul 15 22:16:27.519811 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.519777    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 22:16:27.520823 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:27.520798    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4358b9e3_6422_4dd8_b06a_c8ca5eaf593b.slice/crio-23fb90a1e848802d0a1b14bf020dbf9791ce84c64ee387082621afe3be71d844 WatchSource:0}: Error finding container 23fb90a1e848802d0a1b14bf020dbf9791ce84c64ee387082621afe3be71d844: Status 404 returned error can't find the container with id 23fb90a1e848802d0a1b14bf020dbf9791ce84c64ee387082621afe3be71d844
Jul 15 22:16:27.521319 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.521293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd"
Jul 15 22:16:27.531676 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.531652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9jxh"
Jul 15 22:16:27.533541 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:27.533518    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5657d75b_16ef_4000_b99e_a0037d3a95a9.slice/crio-cab54d1fcfc2a6e6dc676c20529136182347414f280916d74c810bd55b3faa9b WatchSource:0}: Error finding container cab54d1fcfc2a6e6dc676c20529136182347414f280916d74c810bd55b3faa9b: Status 404 returned error can't find the container with id cab54d1fcfc2a6e6dc676c20529136182347414f280916d74c810bd55b3faa9b
Jul 15 22:16:27.542296 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.542274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kst97"
Jul 15 22:16:27.548730 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.548711    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkr2m"
Jul 15 22:16:27.555927 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.555726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-znc7r"
Jul 15 22:16:27.800345 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.800249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:27.800516 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.800424    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:27.800516 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.800505    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.800487502 +0000 UTC m=+4.040405245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:27.900816 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.900761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:27.900816 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:27.900823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:27.901092 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.900966    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:27.901092 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.900976    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:27.901092 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.901057    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:27.901092 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.901074    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:27.901304 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.901074    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.901051572 +0000 UTC m=+4.140969317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:27.901304 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:27.901148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.901133439 +0000 UTC m=+4.141051182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:28.229524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.229447    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:11:27 +0000 UTC" deadline="2028-01-24 00:39:51.276368654 +0000 UTC"
Jul 15 22:16:28.229524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.229478    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13370h23m23.046894211s"
Jul 15 22:16:28.351846 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.351124    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:28.351846 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.351259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:28.351846 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.351680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:28.351846 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.351784    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:28.370520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.370486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd" event={"ID":"5657d75b-16ef-4000-b99e-a0037d3a95a9","Type":"ContainerStarted","Data":"cab54d1fcfc2a6e6dc676c20529136182347414f280916d74c810bd55b3faa9b"}
Jul 15 22:16:28.371955 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.371925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4xthk" event={"ID":"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b","Type":"ContainerStarted","Data":"23fb90a1e848802d0a1b14bf020dbf9791ce84c64ee387082621afe3be71d844"}
Jul 15 22:16:28.378253 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.378220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"fbca16bc308eb61bc98f28d8392158c2482997066dd91549cf848d218ea1c8da"}
Jul 15 22:16:28.380740 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.380712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkskg" event={"ID":"30cc122d-290e-450a-825c-e6d80e6169ee","Type":"ContainerStarted","Data":"938d9583adb7762f7dbacf69c4c426032f4b1d780912c7f031e2f76699b42888"}
Jul 15 22:16:28.382537 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.382510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m45qq" event={"ID":"53b39ae8-2f26-43a1-b878-1c2ce7604556","Type":"ContainerStarted","Data":"ca245e5bec813a2120ebce91c749a00abb0c1080475becbfa0af8e07cf0d0bec"}
Jul 15 22:16:28.810418 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.810378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:28.810615 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.810589    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:28.810720 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.810705    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.810680437 +0000 UTC m=+6.050598177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:28.911130 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.911083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:28.911308 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:28.911157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:28.911371 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.911343    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:28.911371 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.911363    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:28.911469 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.911377    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:28.911653 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.911597    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.911499668 +0000 UTC m=+6.151417433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:28.912049 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.912029    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:28.912144 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:28.912108    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.912074036 +0000 UTC m=+6.151991778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:29.024365 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:29.024299    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ad9a55_da1d_4e05_a578_940a69e21008.slice/crio-5e175a6536725ad119c78b81ee85d6b8884ae928be455649f53d4fccc4e9f2e0 WatchSource:0}: Error finding container 5e175a6536725ad119c78b81ee85d6b8884ae928be455649f53d4fccc4e9f2e0: Status 404 returned error can't find the container with id 5e175a6536725ad119c78b81ee85d6b8884ae928be455649f53d4fccc4e9f2e0
Jul 15 22:16:29.045035 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:29.044841    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975b931e_273b_4022_b8b1_5a966b02d870.slice/crio-7a2ded9aacde852fa2bfb0973c4ca0d9220de6b1ca2bff66c1d2a8af5675b26d WatchSource:0}: Error finding container 7a2ded9aacde852fa2bfb0973c4ca0d9220de6b1ca2bff66c1d2a8af5675b26d: Status 404 returned error can't find the container with id 7a2ded9aacde852fa2bfb0973c4ca0d9220de6b1ca2bff66c1d2a8af5675b26d
Jul 15 22:16:29.063080 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:29.063051    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb067aaff_5ccf_4e4c_84d4_f45517e6aa6a.slice/crio-8a8159adc28fe7ba4a8f8e75a45773ee3c96432fb674a5c31d592edaa42d375c WatchSource:0}: Error finding container 8a8159adc28fe7ba4a8f8e75a45773ee3c96432fb674a5c31d592edaa42d375c: Status 404 returned error can't find the container with id 8a8159adc28fe7ba4a8f8e75a45773ee3c96432fb674a5c31d592edaa42d375c
Jul 15 22:16:29.068343 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:16:29.068319    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4168e9_5194_49cc_87d2_d58a8a57fa65.slice/crio-8154524519a472d25a93ac0f5df63071da7283efe6266d7018cc481db37798da WatchSource:0}: Error finding container 8154524519a472d25a93ac0f5df63071da7283efe6266d7018cc481db37798da: Status 404 returned error can't find the container with id 8154524519a472d25a93ac0f5df63071da7283efe6266d7018cc481db37798da
Jul 15 22:16:29.230425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.230116    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:11:27 +0000 UTC" deadline="2027-12-31 21:04:02.164435249 +0000 UTC"
Jul 15 22:16:29.230425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.230395    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12814h47m32.934045397s"
Jul 15 22:16:29.350756 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.350642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:29.350927 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:29.350816    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:29.390377 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.389702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal" event={"ID":"fd167fdd0eb6d8c7e13b6472e5a2db0d","Type":"ContainerStarted","Data":"479d69efb85bbd57216b29927b1703099a36765641f4892b0b9fa3a291694465"}
Jul 15 22:16:29.393677 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.393641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kst97" event={"ID":"4c4168e9-5194-49cc-87d2-d58a8a57fa65","Type":"ContainerStarted","Data":"8154524519a472d25a93ac0f5df63071da7283efe6266d7018cc481db37798da"}
Jul 15 22:16:29.396602 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.396571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerStarted","Data":"8a8159adc28fe7ba4a8f8e75a45773ee3c96432fb674a5c31d592edaa42d375c"}
Jul 15 22:16:29.398963 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.398936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkr2m" event={"ID":"975b931e-273b-4022-b8b1-5a966b02d870","Type":"ContainerStarted","Data":"7a2ded9aacde852fa2bfb0973c4ca0d9220de6b1ca2bff66c1d2a8af5675b26d"}
Jul 15 22:16:29.402779 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:29.402754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9jxh" event={"ID":"06ad9a55-da1d-4e05-a578-940a69e21008","Type":"ContainerStarted","Data":"5e175a6536725ad119c78b81ee85d6b8884ae928be455649f53d4fccc4e9f2e0"}
Jul 15 22:16:30.351378 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.350629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:30.351378 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.350798    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:30.351378 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.351224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:30.351378 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.351314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:30.410655 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.410614    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5f6e207d96a71851e261e8217ed6731" containerID="67cf38e8fa1df16629ec2bffaf8516524e7ce5103b93966a484740d1975cfc57" exitCode=0
Jul 15 22:16:30.411611 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.411581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal" event={"ID":"b5f6e207d96a71851e261e8217ed6731","Type":"ContainerDied","Data":"67cf38e8fa1df16629ec2bffaf8516524e7ce5103b93966a484740d1975cfc57"}
Jul 15 22:16:30.428492 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.428424    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-92.ec2.internal" podStartSLOduration=4.428400623 podStartE2EDuration="4.428400623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:29.404911767 +0000 UTC m=+4.644829530" watchObservedRunningTime="2026-07-15 22:16:30.428400623 +0000 UTC m=+5.668318385"
Jul 15 22:16:30.828302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.828264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:30.828544 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.828526    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:30.828621 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.828601    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.828578333 +0000 UTC m=+10.068496078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.928767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:30.928821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.928960    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.928982    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.928996    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:30.929443 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.929053    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.929035123 +0000 UTC m=+10.168952864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:30.929889 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.929458    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:30.929889 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:30.929536    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.929513294 +0000 UTC m=+10.169431045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:31.353900 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:31.353868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:31.354116 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:31.354013    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:32.351242 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:32.351206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:32.351724 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:32.351347    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:32.351724 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:32.351472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:32.351724 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:32.351593    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:33.353736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:33.353171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:33.353736 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:33.353315    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:34.350720 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:34.350685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:34.350882 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:34.350732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:34.350882 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.350822    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:34.351035 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.350944    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:34.862943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:34.862834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:34.863392 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.863024    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:34.863392 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.863109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.863086613 +0000 UTC m=+18.103004353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:34.964237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:34.964287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964387    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964424    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964440    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964449    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.964431716 +0000 UTC m=+18.204349457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:34.964457 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964452    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:34.964930 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:34.964486    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.964476425 +0000 UTC m=+18.204394161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:35.351594 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:35.351519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:35.351751 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:35.351646    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:36.350801 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:36.350771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:36.351296 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:36.350815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:36.351296 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:36.350910    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:36.351296 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:36.351051    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:37.351087 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:37.351032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:37.351579 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:37.351174    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:38.351442 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:38.351407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:38.351891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:38.351416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:38.351891 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:38.351527    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:38.351891 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:38.351620    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:39.351494 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:39.351463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:39.351931 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:39.351602    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:40.350891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:40.350857    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:40.350891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:40.350875    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:40.351153 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:40.350970    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:40.351153 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:40.351116    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:41.351116 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:41.351080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:41.351507 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:41.351203    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:42.351366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:42.351336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:42.351366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:42.351363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:42.351866 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:42.351464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:42.351866 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:42.351557    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:42.926674 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:42.926635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:42.926840 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:42.926763    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:42.926840 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:42.926826    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:58.92680945 +0000 UTC m=+34.166727186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:43.026965 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:43.026929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:43.027145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:43.026974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:43.027145 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027091    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:43.027145 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027105    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:43.027145 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027120    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:43.027145 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027131    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:43.027390 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027165    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:16:59.027143633 +0000 UTC m=+34.267061376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:43.027390 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.027187    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:59.027175853 +0000 UTC m=+34.267093594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:43.350673 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:43.350585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:43.350811 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:43.350731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:44.351334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:44.351299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:44.351334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:44.351335    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:44.351734 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:44.351407    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:44.351734 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:44.351479    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:45.351847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:45.351807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:45.352394 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:45.351929    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:46.351557 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:46.351521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:46.351716 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:46.351525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:46.351777 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:46.351702    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:46.351777 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:46.351741    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:47.351626 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.351391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:47.352224 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:47.351747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:47.444479 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.444443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4xthk" event={"ID":"4358b9e3-6422-4dd8-b06a-c8ca5eaf593b","Type":"ContainerStarted","Data":"a4544a6b422fd8c35e5e55526db152371314947bc3cf5e77a3e0dfeeaa7259c3"}
Jul 15 22:16:47.446419 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.446394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"7c9f7034f702b9c2f50a927b25bb3db4080450aee7a07673a9f1d1ac0d9e1f53"}
Jul 15 22:16:47.447932 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.447911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m45qq" event={"ID":"53b39ae8-2f26-43a1-b878-1c2ce7604556","Type":"ContainerStarted","Data":"7020f7d3c04ca18f405b7d9125f05536741aa225ae9ffa82d740a3e16731f754"}
Jul 15 22:16:47.449142 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.449122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kst97" event={"ID":"4c4168e9-5194-49cc-87d2-d58a8a57fa65","Type":"ContainerStarted","Data":"fce051fec404c80dd7ed7d19c007e9af9860c62b6f21fe1d4bdf95dd72351a8b"}
Jul 15 22:16:47.450483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.450456    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="aa9f962845900c7df6bb46754f8be2fe0532fdfa534ca2b8657d1d00ba2cdc5f" exitCode=0
Jul 15 22:16:47.450579 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.450523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"aa9f962845900c7df6bb46754f8be2fe0532fdfa534ca2b8657d1d00ba2cdc5f"}
Jul 15 22:16:47.451965 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.451941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkr2m" event={"ID":"975b931e-273b-4022-b8b1-5a966b02d870","Type":"ContainerStarted","Data":"1b10a4ccb3d8da796c07dda38981ab8500c4642fd8c0b8cea5c952c1b84e8f38"}
Jul 15 22:16:47.453290 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.453267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9jxh" event={"ID":"06ad9a55-da1d-4e05-a578-940a69e21008","Type":"ContainerStarted","Data":"7075c16b02ef670f11653cc555872114898fd164eb6614bdb90b4ace9f9a88a8"}
Jul 15 22:16:47.454999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.454977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal" event={"ID":"b5f6e207d96a71851e261e8217ed6731","Type":"ContainerStarted","Data":"7a3c1c6c6afe719338f8ffdd5ff6175f6adc174b47872e43f424d60788f0878e"}
Jul 15 22:16:47.456484 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.456450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd" event={"ID":"5657d75b-16ef-4000-b99e-a0037d3a95a9","Type":"ContainerStarted","Data":"876064862fa4da95368b7f7dc94ddf4bb520595d8952aaa2144116eaba4530b4"}
Jul 15 22:16:47.463560 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.463520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4xthk" podStartSLOduration=3.07096634 podStartE2EDuration="21.463501753s" totalImagesPullingTime="18.392535413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.463103768 +0000 UTC m=+22.703021518" watchObservedRunningTime="2026-07-15 22:16:47.463501753 +0000 UTC m=+22.703419514"
Jul 15 22:16:47.493140 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.493106    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z9jxh" podStartSLOduration=3.484552598 podStartE2EDuration="21.493095033s" totalImagesPullingTime="18.008542435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.492902599 +0000 UTC m=+22.732820356" watchObservedRunningTime="2026-07-15 22:16:47.493095033 +0000 UTC m=+22.733012790"
Jul 15 22:16:47.493256 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.493238    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-92.ec2.internal" podStartSLOduration=21.493231817 podStartE2EDuration="21.493231817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.478280679 +0000 UTC m=+22.718198438" watchObservedRunningTime="2026-07-15 22:16:47.493231817 +0000 UTC m=+22.733149575"
Jul 15 22:16:47.505321 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.505276    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mkr2m" podStartSLOduration=3.520785644 podStartE2EDuration="21.505264589s" totalImagesPullingTime="17.984478945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.50508323 +0000 UTC m=+22.745000988" watchObservedRunningTime="2026-07-15 22:16:47.505264589 +0000 UTC m=+22.745182367"
Jul 15 22:16:47.537607 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.537565    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m45qq" podStartSLOduration=1.991801949 podStartE2EDuration="21.537553936s" totalImagesPullingTime="19.545751987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.537533149 +0000 UTC m=+22.777450906" watchObservedRunningTime="2026-07-15 22:16:47.537553936 +0000 UTC m=+22.777471677"
Jul 15 22:16:47.551420 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:47.551388    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kst97" podStartSLOduration=3.583519926 podStartE2EDuration="21.551376627s" totalImagesPullingTime="17.967856701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.551172298 +0000 UTC m=+22.791090056" watchObservedRunningTime="2026-07-15 22:16:47.551376627 +0000 UTC m=+22.791294385"
Jul 15 22:16:48.351226 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.351035    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:48.351441 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.351036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:48.351441 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:48.351263    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:48.351441 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:48.351354    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:48.461502 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.461465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:16:48.461930 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.461839    2565 generic.go:356] "Generic (PLEG): container finished" podID="17d3892b-ef76-4653-b740-976c3ef55158" containerID="a7b8765ce6f613944fed85cd5ea2f3aae69c8196e3da4c5b45f623c5e3e85adb" exitCode=1
Jul 15 22:16:48.461930 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.461909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"16e2a92626b0f02bef0ee5e0c17b2292b723e0b7cd311fe44df9cce17cce6fa8"}
Jul 15 22:16:48.462061 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.461988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"5dfc7e42a2a36c4977c418be83b1548483e3f38477562dc8e33b8a6c9ec4f46d"}
Jul 15 22:16:48.462061 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.462055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"79f95a2abce9e45f4d475cd74095654b10e7c1ff11ed3f3e6738c053e0ea9cd3"}
Jul 15 22:16:48.462297 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.462093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"274bfdddf148e38d8b797cefb5459e6543bf936fe76e8cdab8260cf93c837c19"}
Jul 15 22:16:48.462297 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.462136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerDied","Data":"a7b8765ce6f613944fed85cd5ea2f3aae69c8196e3da4c5b45f623c5e3e85adb"}
Jul 15 22:16:48.463523 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.463501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkskg" event={"ID":"30cc122d-290e-450a-825c-e6d80e6169ee","Type":"ContainerStarted","Data":"1f1e19dab63d906473c8aea70997c94f6d9ef427db3e69da2e28768ebc8b6bf9"}
Jul 15 22:16:48.479834 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.479792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hkskg" podStartSLOduration=3.219049617 podStartE2EDuration="22.479774308s" totalImagesPullingTime="19.260724691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:48.47953535 +0000 UTC m=+23.719453109" watchObservedRunningTime="2026-07-15 22:16:48.479774308 +0000 UTC m=+23.719692068"
Jul 15 22:16:48.563551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:48.563522    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 22:16:49.232524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:49.232411    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T22:16:48.56354262Z","UUID":"29456721-15ad-4f21-9667-84372220c0c3","Handler":null,"Name":"","Endpoint":""}
Jul 15 22:16:49.234440 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:49.234412    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 22:16:49.234573 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:49.234459    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 22:16:49.351252 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:49.351137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:49.351425 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:49.351270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:49.467826 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:49.467786    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd" event={"ID":"5657d75b-16ef-4000-b99e-a0037d3a95a9","Type":"ContainerStarted","Data":"2f81a302877f32c50cbe4bc68f15353f14f93cfea230c98f5f4acf2e66afa36d"}
Jul 15 22:16:50.004002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.003769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:50.004406 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.004383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:50.021608 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.021473    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:50.021877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.021858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4xthk"
Jul 15 22:16:50.350698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.350669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:50.350868 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:50.350791    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:50.350868 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.350844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:50.350976 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:50.350962    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:50.472688 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.472656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd" event={"ID":"5657d75b-16ef-4000-b99e-a0037d3a95a9","Type":"ContainerStarted","Data":"f2febf6d7d2ded519bc95a47258b155421e767a26ea80a6d3e684ad939b99ddf"}
Jul 15 22:16:50.476175 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.476153    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:16:50.476728 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.476700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"125f4fd117492afa0165df17e0fc2d96ca596bf2be4acd0a7f473812bd3bed02"}
Jul 15 22:16:50.496111 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.496046    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z2pkd" podStartSLOduration=3.065180004 podStartE2EDuration="24.496027197s" totalImagesPullingTime="21.430847193s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:50.494277452 +0000 UTC m=+25.734195210" watchObservedRunningTime="2026-07-15 22:16:50.496027197 +0000 UTC m=+25.735944948"
Jul 15 22:16:50.917802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:50.917764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:51.019339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:51.019310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:51.351055 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:51.351007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:51.351229 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:51.351136    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:52.351234 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.351097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:52.351764 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.351109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:52.351764 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:52.351318    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:52.351764 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:52.351424    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:52.484733 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.484661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:16:52.485044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.484997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"0b44da2a1c9e74367e630da04f2591388d8e0878900cc9125cb4a82887c2c8c9"}
Jul 15 22:16:52.485265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.485229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:52.485497 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.485480    2565 scope.go:117] "RemoveContainer" containerID="a7b8765ce6f613944fed85cd5ea2f3aae69c8196e3da4c5b45f623c5e3e85adb"
Jul 15 22:16:52.486848 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.486823    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="e59e6fa03a2f24393e34fdd17a9fd26b574e824f13014f10ed067313e69d1ad9" exitCode=0
Jul 15 22:16:52.486959 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.486860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"e59e6fa03a2f24393e34fdd17a9fd26b574e824f13014f10ed067313e69d1ad9"}
Jul 15 22:16:52.501302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:52.501281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:53.350530 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.350501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:53.350674 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:53.350601    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:53.491460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.491435    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:16:53.491814 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.491724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" event={"ID":"17d3892b-ef76-4653-b740-976c3ef55158","Type":"ContainerStarted","Data":"a7c48798a18a64bb710bf1b72a0c97e100cfe2e7a48339ac3fb058616c8c758b"}
Jul 15 22:16:53.491850 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.491823    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 22:16:53.492057 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.492041    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:53.506526 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.506506    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:53.524736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:53.524697    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k" podStartSLOduration=7.767125933 podStartE2EDuration="27.524687273s" totalImagesPullingTime="19.75756134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:53.520508481 +0000 UTC m=+28.760426238" watchObservedRunningTime="2026-07-15 22:16:53.524687273 +0000 UTC m=+28.764605031"
Jul 15 22:16:54.257643 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.257620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:54.350592 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.350567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:54.350592 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.350576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:54.350724 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:54.350649    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:54.350782 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:54.350764    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:54.404509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.404486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:16:54.438816 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.438765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:54.496984 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.496949    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="67f28e5c1a53380257361b8604f468aceed89dd1a707182f1ec9aa8156dd38e0" exitCode=0
Jul 15 22:16:54.497436 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.497044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"67f28e5c1a53380257361b8604f468aceed89dd1a707182f1ec9aa8156dd38e0"}
Jul 15 22:16:54.646674 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.646642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:54.898211 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:54.898132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:55.085670 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.085636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:55.285032 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.284991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:55.351952 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.351932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:55.352072 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:55.352008    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:55.501727 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.501696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerStarted","Data":"7bf656b29f517de2b0f44cf1cd76a2fc39bd4288166bb10e28f88e217acb14b0"}
Jul 15 22:16:55.632353 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.632279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:55.735432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:55.735246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:16:56.064239 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.064214    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ncf8"]
Jul 15 22:16:56.064372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.064310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:56.064425 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:56.064385    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:56.068141 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.068120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6c8dc"]
Jul 15 22:16:56.068260 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.068215    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:56.068359 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:56.068322    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:56.068823 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.068801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4n6n"]
Jul 15 22:16:56.068909 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.068898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:56.068991 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:56.068972    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:56.506442 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.506365    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="7bf656b29f517de2b0f44cf1cd76a2fc39bd4288166bb10e28f88e217acb14b0" exitCode=0
Jul 15 22:16:56.506442 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:56.506424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"7bf656b29f517de2b0f44cf1cd76a2fc39bd4288166bb10e28f88e217acb14b0"}
Jul 15 22:16:57.351132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:57.351101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:57.351274 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:57.351123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:57.351332 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:57.351278    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:57.351398 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:57.351371    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:57.351398 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:57.351175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:57.351492 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:57.351458    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:16:58.947769 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:58.947736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:58.948294 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:58.947893    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:58.948294 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:58.947959    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs podName:7c541bf9-c370-4af5-a454-1755a1903793 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:30.94794138 +0000 UTC m=+66.187859117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs") pod "network-metrics-daemon-6c8dc" (UID: "7c541bf9-c370-4af5-a454-1755a1903793") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 22:16:59.048099 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:59.048069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:59.048099 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:59.048104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:59.048310 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048228    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:59.048310 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048238    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 22:16:59.048310 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048257    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 22:16:59.048310 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048271    2565 projected.go:196] Error preparing data for projected volume kube-api-access-g2zds for pod openshift-network-diagnostics/network-check-target-2ncf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:59.048310 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret podName:3ab3acd4-df38-4b05-8122-a00be2caeefd nodeName:}" failed. No retries permitted until 2026-07-15 22:17:31.048279159 +0000 UTC m=+66.288196908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret") pod "global-pull-secret-syncer-k4n6n" (UID: "3ab3acd4-df38-4b05-8122-a00be2caeefd") : object "kube-system"/"original-pull-secret" not registered
Jul 15 22:16:59.048505 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.048319    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds podName:bd8bbad1-8e24-4788-93df-b46a425dd4a0 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:31.048309306 +0000 UTC m=+66.288227042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g2zds" (UniqueName: "kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds") pod "network-check-target-2ncf8" (UID: "bd8bbad1-8e24-4788-93df-b46a425dd4a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 22:16:59.350483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:59.350452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:16:59.350641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:59.350492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:16:59.350641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:16:59.350459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:16:59.350641 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.350569    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k4n6n" podUID="3ab3acd4-df38-4b05-8122-a00be2caeefd"
Jul 15 22:16:59.350641 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.350635    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6c8dc" podUID="7c541bf9-c370-4af5-a454-1755a1903793"
Jul 15 22:16:59.350849 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:16:59.350707    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2ncf8" podUID="bd8bbad1-8e24-4788-93df-b46a425dd4a0"
Jul 15 22:17:00.042652 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.042619    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-92.ec2.internal" event="NodeReady"
Jul 15 22:17:00.043288 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.042774    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 22:17:00.114609 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.114530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dffc4d584-qlnm8"]
Jul 15 22:17:00.118586 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.118564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.124363 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.124343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 22:17:00.125436 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.125352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 22:17:00.136067 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.136047    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 22:17:00.136211 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.136192    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7x57r\""
Jul 15 22:17:00.146455 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.146433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 22:17:00.160152 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.160124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dffc4d584-qlnm8"]
Jul 15 22:17:00.182632 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.182609    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2vxcc"]
Jul 15 22:17:00.184686 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.184668    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qgl6x"]
Jul 15 22:17:00.184822 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.184800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.186642 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.186613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.195162 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 22:17:00.195294 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195277    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 22:17:00.195367 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vmsfz\""
Jul 15 22:17:00.195564 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195536    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 22:17:00.195650 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195567    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 22:17:00.195830 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195814    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 22:17:00.195982 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.195963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 22:17:00.196101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.196084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 22:17:00.196232 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.196216    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vb4mh\""
Jul 15 22:17:00.211974 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.211912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vxcc"]
Jul 15 22:17:00.212680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.212659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qgl6x"]
Jul 15 22:17:00.250243 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.250218    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xzxq7"]
Jul 15 22:17:00.252307 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.252284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.256803 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-registry-certificates\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.256916 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/624eca87-a31a-4360-90dc-ffcccc46724e-ca-trust-extracted\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.256916 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-trusted-ca\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.256916 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-bound-sa-token\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.257092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256920    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 22:17:00.257092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-image-registry-private-configuration\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.257092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff8j8\""
Jul 15 22:17:00.257092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.256986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-registry-tls\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.257092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.257040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpd4\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-kube-api-access-jdpd4\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.257372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.257102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-installation-pull-secrets\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.257372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.257129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 22:17:00.269616 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.269594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzxq7"]
Jul 15 22:17:00.357636 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-installation-pull-secrets\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.357636 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3362eef7-632f-4401-828e-4bdb260586f7-crio-socket\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.357636 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr77g\" (UniqueName: \"kubernetes.io/projected/3362eef7-632f-4401-828e-4bdb260586f7-kube-api-access-tr77g\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.357877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df18e51-c4b8-47d5-8e80-6e1fcb021214-metrics-tls\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.357877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df18e51-c4b8-47d5-8e80-6e1fcb021214-config-volume\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.357877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrx9n\" (UniqueName: \"kubernetes.io/projected/29c6e97d-23ad-4d91-a06a-d008f5b047de-kube-api-access-wrx9n\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.357877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-registry-certificates\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.357877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3362eef7-632f-4401-828e-4bdb260586f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3362eef7-632f-4401-828e-4bdb260586f7-data-volume\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.357982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/624eca87-a31a-4360-90dc-ffcccc46724e-ca-trust-extracted\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-trusted-ca\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-bound-sa-token\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5lm\" (UniqueName: \"kubernetes.io/projected/9df18e51-c4b8-47d5-8e80-6e1fcb021214-kube-api-access-6j5lm\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-image-registry-private-configuration\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3362eef7-632f-4401-828e-4bdb260586f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.358151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df18e51-c4b8-47d5-8e80-6e1fcb021214-tmp-dir\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.358545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29c6e97d-23ad-4d91-a06a-d008f5b047de-cert\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.358545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-registry-tls\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpd4\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-kube-api-access-jdpd4\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/624eca87-a31a-4360-90dc-ffcccc46724e-ca-trust-extracted\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358760 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-registry-certificates\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.358988 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.358965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/624eca87-a31a-4360-90dc-ffcccc46724e-trusted-ca\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.362755 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.362732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-image-registry-private-configuration\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.362845 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.362790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-registry-tls\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.362845 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.362833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/624eca87-a31a-4360-90dc-ffcccc46724e-installation-pull-secrets\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.369749 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.369727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpd4\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-kube-api-access-jdpd4\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.372669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.372648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/624eca87-a31a-4360-90dc-ffcccc46724e-bound-sa-token\") pod \"image-registry-5dffc4d584-qlnm8\" (UID: \"624eca87-a31a-4360-90dc-ffcccc46724e\") " pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.432476 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.432448    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:00.459443 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3362eef7-632f-4401-828e-4bdb260586f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.459542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3362eef7-632f-4401-828e-4bdb260586f7-data-volume\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.459542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5lm\" (UniqueName: \"kubernetes.io/projected/9df18e51-c4b8-47d5-8e80-6e1fcb021214-kube-api-access-6j5lm\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.459542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3362eef7-632f-4401-828e-4bdb260586f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.459542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df18e51-c4b8-47d5-8e80-6e1fcb021214-tmp-dir\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29c6e97d-23ad-4d91-a06a-d008f5b047de-cert\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3362eef7-632f-4401-828e-4bdb260586f7-crio-socket\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr77g\" (UniqueName: \"kubernetes.io/projected/3362eef7-632f-4401-828e-4bdb260586f7-kube-api-access-tr77g\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df18e51-c4b8-47d5-8e80-6e1fcb021214-metrics-tls\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df18e51-c4b8-47d5-8e80-6e1fcb021214-config-volume\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.459744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrx9n\" (UniqueName: \"kubernetes.io/projected/29c6e97d-23ad-4d91-a06a-d008f5b047de-kube-api-access-wrx9n\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.460056 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3362eef7-632f-4401-828e-4bdb260586f7-crio-socket\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.460056 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459816    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3362eef7-632f-4401-828e-4bdb260586f7-data-volume\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.460056 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.459934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9df18e51-c4b8-47d5-8e80-6e1fcb021214-tmp-dir\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.460487 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.460464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3362eef7-632f-4401-828e-4bdb260586f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.460566 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.460510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9df18e51-c4b8-47d5-8e80-6e1fcb021214-config-volume\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.461991 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.461974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3362eef7-632f-4401-828e-4bdb260586f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.462317 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.462301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9df18e51-c4b8-47d5-8e80-6e1fcb021214-metrics-tls\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.462369 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.462305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29c6e97d-23ad-4d91-a06a-d008f5b047de-cert\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.476571 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.476544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:00.477580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.477556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrx9n\" (UniqueName: \"kubernetes.io/projected/29c6e97d-23ad-4d91-a06a-d008f5b047de-kube-api-access-wrx9n\") pod \"ingress-canary-qgl6x\" (UID: \"29c6e97d-23ad-4d91-a06a-d008f5b047de\") " pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.477851 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.477834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5lm\" (UniqueName: \"kubernetes.io/projected/9df18e51-c4b8-47d5-8e80-6e1fcb021214-kube-api-access-6j5lm\") pod \"dns-default-xzxq7\" (UID: \"9df18e51-c4b8-47d5-8e80-6e1fcb021214\") " pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.478276 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.478255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr77g\" (UniqueName: \"kubernetes.io/projected/3362eef7-632f-4401-828e-4bdb260586f7-kube-api-access-tr77g\") pod \"insights-runtime-extractor-2vxcc\" (UID: \"3362eef7-632f-4401-828e-4bdb260586f7\") " pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.495131 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.495112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2vxcc"
Jul 15 22:17:00.501495 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.501478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qgl6x"
Jul 15 22:17:00.562917 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.562897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:00.659655 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.659442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:00.818954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.818927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzxq7"]
Jul 15 22:17:00.825333 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.824967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dffc4d584-qlnm8"]
Jul 15 22:17:00.825997 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.825965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2vxcc"]
Jul 15 22:17:00.835144 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.835117    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qgl6x"]
Jul 15 22:17:00.838834 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:00.838811    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df18e51_c4b8_47d5_8e80_6e1fcb021214.slice/crio-656973fa5936f78e0bd549731c279958a5a1fad288e3f90bd912249314ffb6e9 WatchSource:0}: Error finding container 656973fa5936f78e0bd549731c279958a5a1fad288e3f90bd912249314ffb6e9: Status 404 returned error can't find the container with id 656973fa5936f78e0bd549731c279958a5a1fad288e3f90bd912249314ffb6e9
Jul 15 22:17:00.840451 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:00.840417    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624eca87_a31a_4360_90dc_ffcccc46724e.slice/crio-43ce242cd68b3f116f7cddb773936ad8c496eec338d48ce616cba529689ba32d WatchSource:0}: Error finding container 43ce242cd68b3f116f7cddb773936ad8c496eec338d48ce616cba529689ba32d: Status 404 returned error can't find the container with id 43ce242cd68b3f116f7cddb773936ad8c496eec338d48ce616cba529689ba32d
Jul 15 22:17:00.841050 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:00.840936    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3362eef7_632f_4401_828e_4bdb260586f7.slice/crio-fefdfd0d04fbe87f2b3a466c93f89ecf471fabec0400e9b82de000843d8991f7 WatchSource:0}: Error finding container fefdfd0d04fbe87f2b3a466c93f89ecf471fabec0400e9b82de000843d8991f7: Status 404 returned error can't find the container with id fefdfd0d04fbe87f2b3a466c93f89ecf471fabec0400e9b82de000843d8991f7
Jul 15 22:17:00.842430 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:00.842378    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c6e97d_23ad_4d91_a06a_d008f5b047de.slice/crio-fec88db037b20830fbe14b22fbd0b1f157173241a669546bd9d16a4ecd4226fa WatchSource:0}: Error finding container fec88db037b20830fbe14b22fbd0b1f157173241a669546bd9d16a4ecd4226fa: Status 404 returned error can't find the container with id fec88db037b20830fbe14b22fbd0b1f157173241a669546bd9d16a4ecd4226fa
Jul 15 22:17:00.849742 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.849714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:00.986290 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:00.986156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:01.104647 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.104614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:01.351471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.351444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:17:01.351615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.351444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:17:01.351779 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.351446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.355625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.355653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.355671    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.355625    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\""
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.355627    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\""
Jul 15 22:17:01.356145 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.356007    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 22:17:01.370469 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.370446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:01.520630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.520594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vxcc" event={"ID":"3362eef7-632f-4401-828e-4bdb260586f7","Type":"ContainerStarted","Data":"fefdfd0d04fbe87f2b3a466c93f89ecf471fabec0400e9b82de000843d8991f7"}
Jul 15 22:17:01.522600 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.522479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8" event={"ID":"624eca87-a31a-4360-90dc-ffcccc46724e","Type":"ContainerStarted","Data":"0c4bf98c2983fbf09eee6efe0c8adefcd009ca51c93a5c74948680ab91b5d5de"}
Jul 15 22:17:01.522600 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.522564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8" event={"ID":"624eca87-a31a-4360-90dc-ffcccc46724e","Type":"ContainerStarted","Data":"43ce242cd68b3f116f7cddb773936ad8c496eec338d48ce616cba529689ba32d"}
Jul 15 22:17:01.522794 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.522610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:01.523882 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.523855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qgl6x" event={"ID":"29c6e97d-23ad-4d91-a06a-d008f5b047de","Type":"ContainerStarted","Data":"fec88db037b20830fbe14b22fbd0b1f157173241a669546bd9d16a4ecd4226fa"}
Jul 15 22:17:01.527773 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.527684    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="8b454e351b4992df4cad9d8e2062882e139d3bee7f4e636b321b12c307195c9b" exitCode=0
Jul 15 22:17:01.527866 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.527772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"8b454e351b4992df4cad9d8e2062882e139d3bee7f4e636b321b12c307195c9b"}
Jul 15 22:17:01.529557 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.529509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzxq7" event={"ID":"9df18e51-c4b8-47d5-8e80-6e1fcb021214","Type":"ContainerStarted","Data":"656973fa5936f78e0bd549731c279958a5a1fad288e3f90bd912249314ffb6e9"}
Jul 15 22:17:01.563227 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:01.561977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8" podStartSLOduration=7.56195854 podStartE2EDuration="7.56195854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:01.561548027 +0000 UTC m=+36.801465785" watchObservedRunningTime="2026-07-15 22:17:01.56195854 +0000 UTC m=+36.801876282"
Jul 15 22:17:02.538548 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:02.537824    2565 generic.go:356] "Generic (PLEG): container finished" podID="b067aaff-5ccf-4e4c-84d4-f45517e6aa6a" containerID="0c02d9f0fceb043f3bbbbf785d165d16d9cfcab6e65d44b9122f41574064d773" exitCode=0
Jul 15 22:17:02.538548 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:02.538028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerDied","Data":"0c02d9f0fceb043f3bbbbf785d165d16d9cfcab6e65d44b9122f41574064d773"}
Jul 15 22:17:03.545907 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:03.545868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-znc7r" event={"ID":"b067aaff-5ccf-4e4c-84d4-f45517e6aa6a","Type":"ContainerStarted","Data":"9c0b73a72d34042db54ed4670c6c24748ecf1175ea9ea02460b3a4312468b787"}
Jul 15 22:17:03.580628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:03.580544    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-znc7r" podStartSLOduration=8.66541869 podStartE2EDuration="37.580529903s" totalImagesPullingTime="28.915111213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:03.580231775 +0000 UTC m=+38.820149534" watchObservedRunningTime="2026-07-15 22:17:03.580529903 +0000 UTC m=+38.820447661"
Jul 15 22:17:04.268053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:04.268028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:04.367208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:04.367180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:04.550782 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:04.550711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzxq7" event={"ID":"9df18e51-c4b8-47d5-8e80-6e1fcb021214","Type":"ContainerStarted","Data":"9ae3798af9e34be1a60b7c6dc303a133073b2776f1695d6fe0af5cb156f5fc88"}
Jul 15 22:17:05.090309 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:05.090279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:05.901970 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:05.901936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:06.002744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:06.002715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:06.392544 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:06.392515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:06.462622 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:06.462588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:08.292978 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.292922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:08.459249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.459226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:08.562567 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.562518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzxq7" event={"ID":"9df18e51-c4b8-47d5-8e80-6e1fcb021214","Type":"ContainerStarted","Data":"86bfca96610712e52221b146e68e0716ad17ab29164c7179ef2600981153ebf1"}
Jul 15 22:17:08.562656 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.562624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:08.564086 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.564064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vxcc" event={"ID":"3362eef7-632f-4401-828e-4bdb260586f7","Type":"ContainerStarted","Data":"531b235bf51e03594c09e40ad90aba3754c10565513595ca87b3d86b9bba7529"}
Jul 15 22:17:08.565397 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.565376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qgl6x" event={"ID":"29c6e97d-23ad-4d91-a06a-d008f5b047de","Type":"ContainerStarted","Data":"54386b9383957426b38ef5e7b37453c85483fe41881771e438065049417f53aa"}
Jul 15 22:17:08.595028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.594973    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xzxq7" podStartSLOduration=5.502803708 podStartE2EDuration="8.594961631s" totalImagesPullingTime="3.092157923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:08.593544281 +0000 UTC m=+43.833462040" watchObservedRunningTime="2026-07-15 22:17:08.594961631 +0000 UTC m=+43.834879389"
Jul 15 22:17:08.643362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:08.643313    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qgl6x" podStartSLOduration=2.407858382 podStartE2EDuration="8.643301358s" totalImagesPullingTime="6.235442976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:08.642480106 +0000 UTC m=+43.882397865" watchObservedRunningTime="2026-07-15 22:17:08.643301358 +0000 UTC m=+43.883219116"
Jul 15 22:17:09.056092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:09.056058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:09.131744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:09.131686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:09.661418 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:09.661383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:12.742480 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:12.742456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:12.844827 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:12.844796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:13.587938 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:13.587900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vxcc" event={"ID":"3362eef7-632f-4401-828e-4bdb260586f7","Type":"ContainerStarted","Data":"ef14832498c87b8e8d77d5d7c0e3c2bc72c72d1aade5f63b886cd42528e03519"}
Jul 15 22:17:13.831617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:13.831586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:13.930054 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:13.929955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:15.571995 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:15.571963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xzxq7"
Jul 15 22:17:15.899124 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:15.899042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:15.999550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:15.999516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:16.225191 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:16.225120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:17.601653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:17.601619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2vxcc" event={"ID":"3362eef7-632f-4401-828e-4bdb260586f7","Type":"ContainerStarted","Data":"3a7bc34265de01c945e06191fbcf1d8e7acc2996703439d1e280ba3a08ee2a94"}
Jul 15 22:17:17.620597 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:17.620551    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2vxcc" podStartSLOduration=2.163486567 podStartE2EDuration="17.620536032s" totalImagesPullingTime="15.457049465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:17.61919122 +0000 UTC m=+52.859108978" watchObservedRunningTime="2026-07-15 22:17:17.620536032 +0000 UTC m=+52.860453792"
Jul 15 22:17:18.225715 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.225683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:18.422047 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.422008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:18.555501 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.555476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dhfst"]
Jul 15 22:17:18.581972 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.581953    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-66lm6"]
Jul 15 22:17:18.582106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.582090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.586799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.586777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:18.588237 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.587996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 22:17:18.588612 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.588588    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 22:17:18.588694 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.588622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 22:17:18.589729 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.589710    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 22:17:18.600268 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.600247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 22:17:18.602175 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.602156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qc2q4\""
Jul 15 22:17:18.602547 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.602400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 22:17:18.605871 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.605854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.609100 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.609086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 22:17:18.609429 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.609417    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 22:17:18.609880 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.609858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 22:17:18.610022 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.609995    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rs8mb\""
Jul 15 22:17:18.624051 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.624032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-66lm6"]
Jul 15 22:17:18.700743 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.700886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-sys\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.700886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fb58813-5bd7-43a9-a83a-28b070f7dfee-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.700886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-wtmp\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.700886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-textfile\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.700977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.701070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.701070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-tls\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701146    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57c7t\" (UniqueName: \"kubernetes.io/projected/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-api-access-57c7t\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-metrics-client-ca\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-root\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.701339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.701306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhsk\" (UniqueName: \"kubernetes.io/projected/80bcb209-e532-4723-9d5e-68654aab2862-kube-api-access-lnhsk\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.786384 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.786359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:18.801741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.801841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57c7t\" (UniqueName: \"kubernetes.io/projected/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-api-access-57c7t\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.801841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-metrics-client-ca\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.801841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-root\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.801841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhsk\" (UniqueName: \"kubernetes.io/projected/80bcb209-e532-4723-9d5e-68654aab2862-kube-api-access-lnhsk\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.801996 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-root\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.801996 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.801992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-sys\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fb58813-5bd7-43a9-a83a-28b070f7dfee-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-wtmp\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-textfile\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-sys\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-tls\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-wtmp\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-accelerators-collector-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80bcb209-e532-4723-9d5e-68654aab2862-metrics-client-ca\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:18.802439    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5fb58813-5bd7-43a9-a83a-28b070f7dfee-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802545 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:18.802494    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls podName:5fb58813-5bd7-43a9-a83a-28b070f7dfee nodeName:}" failed. No retries permitted until 2026-07-15 22:17:19.302475449 +0000 UTC m=+54.542393194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-66lm6" (UID: "5fb58813-5bd7-43a9-a83a-28b070f7dfee") : secret "kube-state-metrics-tls" not found
Jul 15 22:17:18.802826 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-textfile\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.802942 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.802987 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.802971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.805870 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.805817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.805945 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.805909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.806144 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.805982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/80bcb209-e532-4723-9d5e-68654aab2862-node-exporter-tls\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.838106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.838082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhsk\" (UniqueName: \"kubernetes.io/projected/80bcb209-e532-4723-9d5e-68654aab2862-kube-api-access-lnhsk\") pod \"node-exporter-dhfst\" (UID: \"80bcb209-e532-4723-9d5e-68654aab2862\") " pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.838322 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.838305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57c7t\" (UniqueName: \"kubernetes.io/projected/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-api-access-57c7t\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:18.891289 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:18.891266    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dhfst"
Jul 15 22:17:18.900417 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:18.900395    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bcb209_e532_4723_9d5e_68654aab2862.slice/crio-182c5d5c0d3222f04e96f483cb8d3ecbf314a6fa00a852bb1ef6f0e329962ec7 WatchSource:0}: Error finding container 182c5d5c0d3222f04e96f483cb8d3ecbf314a6fa00a852bb1ef6f0e329962ec7: Status 404 returned error can't find the container with id 182c5d5c0d3222f04e96f483cb8d3ecbf314a6fa00a852bb1ef6f0e329962ec7
Jul 15 22:17:19.166720 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.166632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:19.304235 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.304209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:19.304363 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:19.304322    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 22:17:19.304412 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:19.304386    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls podName:5fb58813-5bd7-43a9-a83a-28b070f7dfee nodeName:}" failed. No retries permitted until 2026-07-15 22:17:20.304367917 +0000 UTC m=+55.544285661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-66lm6" (UID: "5fb58813-5bd7-43a9-a83a-28b070f7dfee") : secret "kube-state-metrics-tls" not found
Jul 15 22:17:19.304712 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.304694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:19.514526 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.514502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:19.607868 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.607844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhfst" event={"ID":"80bcb209-e532-4723-9d5e-68654aab2862","Type":"ContainerStarted","Data":"182c5d5c0d3222f04e96f483cb8d3ecbf314a6fa00a852bb1ef6f0e329962ec7"}
Jul 15 22:17:19.634400 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.634377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:19.737841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:19.737818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:20.310933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.310895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:20.313745 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.313715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5fb58813-5bd7-43a9-a83a-28b070f7dfee-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-66lm6\" (UID: \"5fb58813-5bd7-43a9-a83a-28b070f7dfee\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:20.413171 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.413135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6"
Jul 15 22:17:20.437439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.437408    2565 patch_prober.go:28] interesting pod/image-registry-5dffc4d584-qlnm8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 22:17:20.437542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.437464    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8" podUID="624eca87-a31a-4360-90dc-ffcccc46724e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 22:17:20.463572 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.463535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:20.563499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.563406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:20.711923 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:20.711897    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-66lm6"]
Jul 15 22:17:20.714322 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:20.714301    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb58813_5bd7_43a9_a83a_28b070f7dfee.slice/crio-f8a44017e55c12e35062cc62fba99bbb4e08fba60ed80788cf446257f83b44f6 WatchSource:0}: Error finding container f8a44017e55c12e35062cc62fba99bbb4e08fba60ed80788cf446257f83b44f6: Status 404 returned error can't find the container with id f8a44017e55c12e35062cc62fba99bbb4e08fba60ed80788cf446257f83b44f6
Jul 15 22:17:21.526034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.525991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:21.618545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.618507    2565 generic.go:356] "Generic (PLEG): container finished" podID="80bcb209-e532-4723-9d5e-68654aab2862" containerID="5193bfbfe24cfafad1406c345b5f3d371deb0476e79dc845c4c013facfca3c2a" exitCode=0
Jul 15 22:17:21.618703 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.618592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhfst" event={"ID":"80bcb209-e532-4723-9d5e-68654aab2862","Type":"ContainerDied","Data":"5193bfbfe24cfafad1406c345b5f3d371deb0476e79dc845c4c013facfca3c2a"}
Jul 15 22:17:21.619888 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.619859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6" event={"ID":"5fb58813-5bd7-43a9-a83a-28b070f7dfee","Type":"ContainerStarted","Data":"f8a44017e55c12e35062cc62fba99bbb4e08fba60ed80788cf446257f83b44f6"}
Jul 15 22:17:21.628908 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.628885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:21.712028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.711984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:21.879140 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:21.879061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:22.542694 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.542668    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dffc4d584-qlnm8"
Jul 15 22:17:22.587512 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.587483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:22.625307 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.625272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhfst" event={"ID":"80bcb209-e532-4723-9d5e-68654aab2862","Type":"ContainerStarted","Data":"c698520ccb008207d3a74606bcbcf3f9bf6a0eff1c72b9380c0555262d892e8c"}
Jul 15 22:17:22.625485 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.625332    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dhfst" event={"ID":"80bcb209-e532-4723-9d5e-68654aab2862","Type":"ContainerStarted","Data":"e98558b3e1bc92e0808d4f1b14e1d9874a87b50212f7c41af65bc6523cef2b3c"}
Jul 15 22:17:22.627486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.627458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6" event={"ID":"5fb58813-5bd7-43a9-a83a-28b070f7dfee","Type":"ContainerStarted","Data":"29665b75d9998a1e37b5c6f80a0d7667d03d5e16b5e21174ffd627073b1cef06"}
Jul 15 22:17:22.627604 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.627515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6" event={"ID":"5fb58813-5bd7-43a9-a83a-28b070f7dfee","Type":"ContainerStarted","Data":"c877b767bf18793c92a199f3118a6753d368abf0aa5a97d85f086b383ee82a53"}
Jul 15 22:17:22.627604 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.627551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6" event={"ID":"5fb58813-5bd7-43a9-a83a-28b070f7dfee","Type":"ContainerStarted","Data":"2c99f2e4fc110e009d3c6108eb0d29a26183834aae37c1954475422b91b21bc8"}
Jul 15 22:17:22.644461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.644415    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dhfst" podStartSLOduration=2.847645863 podStartE2EDuration="4.644401027s" totalImagesPullingTime="1.732197012s" totalInitContainerRuntime="64.558152ms" isStatefulPod=true podCreationTimestamp="2026-07-15 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:22.643379655 +0000 UTC m=+57.883297413" watchObservedRunningTime="2026-07-15 22:17:22.644401027 +0000 UTC m=+57.884318786"
Jul 15 22:17:22.662484 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.662354    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-66lm6" podStartSLOduration=3.255942817 podStartE2EDuration="4.66233989s" totalImagesPullingTime="1.406397073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:22.661925457 +0000 UTC m=+57.901843218" watchObservedRunningTime="2026-07-15 22:17:22.66233989 +0000 UTC m=+57.902257651"
Jul 15 22:17:22.687671 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.687649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:22.787641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.787621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:22.889436 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:22.889374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.138840 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.138806    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-786df47645-njqg5"]
Jul 15 22:17:23.141629 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.141573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.143795 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.143774    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 22:17:23.144589 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.144574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-wk8bp\""
Jul 15 22:17:23.144649 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.144636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 15 22:17:23.144856 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.144838    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 15 22:17:23.144922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.144846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-32kic7ge5fv4s\""
Jul 15 22:17:23.145102 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.145089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 15 22:17:23.154383 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.154363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-786df47645-njqg5"]
Jul 15 22:17:23.235976 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.235955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bc4be4c3-abc4-40d6-8168-853e182028d9-audit-log\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236095 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.235998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-metrics-server-audit-profiles\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236095 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.236039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-client-certs\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236095 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.236059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.236133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-tls\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.236226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-client-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.236345 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.236256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4t7q\" (UniqueName: \"kubernetes.io/projected/bc4be4c3-abc4-40d6-8168-853e182028d9-kube-api-access-z4t7q\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.259507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.259481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.270983 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.270959    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"]
Jul 15 22:17:23.272917 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.272903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.275266 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.275241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 22:17:23.275539 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.275525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-x2rrc\""
Jul 15 22:17:23.291639 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.291614    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"]
Jul 15 22:17:23.337356 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bc4be4c3-abc4-40d6-8168-853e182028d9-audit-log\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337452 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-metrics-server-audit-profiles\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337452 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-client-certs\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337452 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.337452 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-tls\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwpxp\" (UniqueName: \"kubernetes.io/projected/fd168b27-40c9-4850-9630-2cc2f06b1428-kube-api-access-lwpxp\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.337653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-client-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4t7q\" (UniqueName: \"kubernetes.io/projected/bc4be4c3-abc4-40d6-8168-853e182028d9-kube-api-access-z4t7q\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.337842 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.337739    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bc4be4c3-abc4-40d6-8168-853e182028d9-audit-log\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.338213 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.338190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.338358 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.338337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bc4be4c3-abc4-40d6-8168-853e182028d9-metrics-server-audit-profiles\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.339791 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.339765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-tls\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.340071 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.340049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-secret-metrics-server-client-certs\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.340143 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.340068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bc4be4c3-abc4-40d6-8168-853e182028d9-client-ca-bundle\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.351267 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.351243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4t7q\" (UniqueName: \"kubernetes.io/projected/bc4be4c3-abc4-40d6-8168-853e182028d9-kube-api-access-z4t7q\") pod \"metrics-server-786df47645-njqg5\" (UID: \"bc4be4c3-abc4-40d6-8168-853e182028d9\") " pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.381000 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.380976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.438499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.438455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.438579 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.438503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwpxp\" (UniqueName: \"kubernetes.io/projected/fd168b27-40c9-4850-9630-2cc2f06b1428-kube-api-access-lwpxp\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.438616 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:23.438586    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 22:17:23.438649 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:17:23.438646    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert podName:fd168b27-40c9-4850-9630-2cc2f06b1428 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:23.938632557 +0000 UTC m=+59.178550296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-bzhdj" (UID: "fd168b27-40c9-4850-9630-2cc2f06b1428") : secret "monitoring-plugin-cert" not found
Jul 15 22:17:23.448097 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.448079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwpxp\" (UniqueName: \"kubernetes.io/projected/fd168b27-40c9-4850-9630-2cc2f06b1428-kube-api-access-lwpxp\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.449929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.449908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:23.476252 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.476210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.569642 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.569618    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-786df47645-njqg5"]
Jul 15 22:17:23.572314 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:23.572288    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4be4c3_abc4_40d6_8168_853e182028d9.slice/crio-8267d432136c25b979da455e418bccbfcbe0e7bb60a1be5e9f70df30085048b2 WatchSource:0}: Error finding container 8267d432136c25b979da455e418bccbfcbe0e7bb60a1be5e9f70df30085048b2: Status 404 returned error can't find the container with id 8267d432136c25b979da455e418bccbfcbe0e7bb60a1be5e9f70df30085048b2
Jul 15 22:17:23.588234 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.588208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.631205 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.631179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-786df47645-njqg5" event={"ID":"bc4be4c3-abc4-40d6-8168-853e182028d9","Type":"ContainerStarted","Data":"8267d432136c25b979da455e418bccbfcbe0e7bb60a1be5e9f70df30085048b2"}
Jul 15 22:17:23.776654 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.776630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.912043 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.911996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:23.941676 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.941653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:23.943803 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:23.943786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fd168b27-40c9-4850-9630-2cc2f06b1428-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-bzhdj\" (UID: \"fd168b27-40c9-4850-9630-2cc2f06b1428\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:24.181134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.181070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:24.261975 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.261942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:24.313480 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.313457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"]
Jul 15 22:17:24.315944 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:24.315914    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd168b27_40c9_4850_9630_2cc2f06b1428.slice/crio-e55fa0ad561443715529e8b173e01ad19aac049acdf79470d111efa281ab5782 WatchSource:0}: Error finding container e55fa0ad561443715529e8b173e01ad19aac049acdf79470d111efa281ab5782: Status 404 returned error can't find the container with id e55fa0ad561443715529e8b173e01ad19aac049acdf79470d111efa281ab5782
Jul 15 22:17:24.386245 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.386218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:24.478630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.478560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:24.635745 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.635712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj" event={"ID":"fd168b27-40c9-4850-9630-2cc2f06b1428","Type":"ContainerStarted","Data":"e55fa0ad561443715529e8b173e01ad19aac049acdf79470d111efa281ab5782"}
Jul 15 22:17:24.887170 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.887137    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 22:17:24.889689 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.889627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:24.896243 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.896221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.901476 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.901457    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 22:17:24.901780 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.901759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 22:17:24.901897 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.901826    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 22:17:24.901991 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.901973    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9e417jesptibq\""
Jul 15 22:17:24.903052 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.902677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.904689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.904915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.905083    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.905162    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.905328    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.905578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c6jg4\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.905956    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 22:17:24.907922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.907633    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 22:17:24.908548 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.908517    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 22:17:24.908753 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.908732    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 22:17:24.918525 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.918502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 22:17:24.918971 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.918949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 22:17:24.948825 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.948935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.948935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-web-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.948935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.948969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-config-out\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d2pz\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-kube-api-access-9d2pz\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:24.949837 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:24.949393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050291 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050291 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-config-out\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d2pz\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-kube-api-access-9d2pz\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.050933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-web-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.050974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.051137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.051156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.051593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.051970 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.051947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.052133 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.051988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.052646 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.052315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.053871 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.053843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.054317 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.054289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a94508ba-faba-44bb-8e32-093cfc409c43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.054408 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.054370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.055825 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.055115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.055825 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.055249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.055825 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.055653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.055825 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.055672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056119 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.055951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.056186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.056306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-web-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.056407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a94508ba-faba-44bb-8e32-093cfc409c43-config-out\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.056577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.056975 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.056955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a94508ba-faba-44bb-8e32-093cfc409c43-config\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.064420 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.064400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d2pz\" (UniqueName: \"kubernetes.io/projected/a94508ba-faba-44bb-8e32-093cfc409c43-kube-api-access-9d2pz\") pod \"prometheus-k8s-0\" (UID: \"a94508ba-faba-44bb-8e32-093cfc409c43\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.213148 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.213090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c6jg4\""
Jul 15 22:17:25.220610 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.220588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:25.381954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.381924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 22:17:25.444490 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:25.444448    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94508ba_faba_44bb_8e32_093cfc409c43.slice/crio-b68bf9a83e350cb2bd7389c8c1cfada2120d5d933f82b407f5ebf0fec2b96de2 WatchSource:0}: Error finding container b68bf9a83e350cb2bd7389c8c1cfada2120d5d933f82b407f5ebf0fec2b96de2: Status 404 returned error can't find the container with id b68bf9a83e350cb2bd7389c8c1cfada2120d5d933f82b407f5ebf0fec2b96de2
Jul 15 22:17:25.524549 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.524524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cw62k"
Jul 15 22:17:25.641486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.641421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-786df47645-njqg5" event={"ID":"bc4be4c3-abc4-40d6-8168-853e182028d9","Type":"ContainerStarted","Data":"85247491f74eca8aae4019d38ff8f77664724ee3f7b24d909f44edd372f0ebcc"}
Jul 15 22:17:25.642795 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.642768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"b68bf9a83e350cb2bd7389c8c1cfada2120d5d933f82b407f5ebf0fec2b96de2"}
Jul 15 22:17:25.659058 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.658995    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-786df47645-njqg5" podStartSLOduration=0.76567208 podStartE2EDuration="2.658974459s" totalImagesPullingTime="1.893302379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:25.658507998 +0000 UTC m=+60.898425749" watchObservedRunningTime="2026-07-15 22:17:25.658974459 +0000 UTC m=+60.898892218"
Jul 15 22:17:25.660406 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.660378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:25.762885 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.762857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:25.860285 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.860222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:25.939893 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:25.939862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:27.650605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.650571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj" event={"ID":"fd168b27-40c9-4850-9630-2cc2f06b1428","Type":"ContainerStarted","Data":"798a4ba325741123434e34c04d50d9b4cc0f81b632b070c03698ee20d9fc4738"}
Jul 15 22:17:27.651054 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.650747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:27.652208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.652183    2565 generic.go:356] "Generic (PLEG): container finished" podID="a94508ba-faba-44bb-8e32-093cfc409c43" containerID="dbd7528df409d2367dbb5c0d92cde495dc9218d5478be076b32d0f164bf65d58" exitCode=0
Jul 15 22:17:27.652300 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.652271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerDied","Data":"dbd7528df409d2367dbb5c0d92cde495dc9218d5478be076b32d0f164bf65d58"}
Jul 15 22:17:27.655669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.655651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj"
Jul 15 22:17:27.683165 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:27.683124    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-bzhdj" podStartSLOduration=2.406978315 podStartE2EDuration="4.683111651s" totalImagesPullingTime="2.276133336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:27.68226171 +0000 UTC m=+62.922179470" watchObservedRunningTime="2026-07-15 22:17:27.683111651 +0000 UTC m=+62.923029409"
Jul 15 22:17:28.010220 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:28.010150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:28.140686 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:28.140662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:28.269677 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:28.269651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:29.918917 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:29.918877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:30.018208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:30.018163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:30.820058 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:30.820005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:30.920142 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:30.920106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:30.999949 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:30.999911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:17:31.002497 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.002476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 22:17:31.012787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.012757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c541bf9-c370-4af5-a454-1755a1903793-metrics-certs\") pod \"network-metrics-daemon-6c8dc\" (UID: \"7c541bf9-c370-4af5-a454-1755a1903793\") " pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:17:31.091580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.091525    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\""
Jul 15 22:17:31.099640 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.099615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6c8dc"
Jul 15 22:17:31.101026 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.100991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:17:31.101131 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.101104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:17:31.103401 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.103373    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 22:17:31.103507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.103414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 22:17:31.113339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.113316    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 22:17:31.113592 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.113568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ab3acd4-df38-4b05-8122-a00be2caeefd-original-pull-secret\") pod \"global-pull-secret-syncer-k4n6n\" (UID: \"3ab3acd4-df38-4b05-8122-a00be2caeefd\") " pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:17:31.124592 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.124568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2zds\" (UniqueName: \"kubernetes.io/projected/bd8bbad1-8e24-4788-93df-b46a425dd4a0-kube-api-access-g2zds\") pod \"network-check-target-2ncf8\" (UID: \"bd8bbad1-8e24-4788-93df-b46a425dd4a0\") " pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:17:31.366150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.366076    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\""
Jul 15 22:17:31.374280 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.374258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:17:31.394483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.394462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k4n6n"
Jul 15 22:17:31.574523 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.574463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6c8dc"]
Jul 15 22:17:31.576330 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:31.576298    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c541bf9_c370_4af5_a454_1755a1903793.slice/crio-5590a794ea48669141e076598c976d88b097d15f42cfe5134d713a536be9708c WatchSource:0}: Error finding container 5590a794ea48669141e076598c976d88b097d15f42cfe5134d713a536be9708c: Status 404 returned error can't find the container with id 5590a794ea48669141e076598c976d88b097d15f42cfe5134d713a536be9708c
Jul 15 22:17:31.674966 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.674940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"93a87d2663b4d13d3f99730a9e48a862adfa6380405d12d4b8b01b63ec9fc807"}
Jul 15 22:17:31.676073 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.676039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c8dc" event={"ID":"7c541bf9-c370-4af5-a454-1755a1903793","Type":"ContainerStarted","Data":"5590a794ea48669141e076598c976d88b097d15f42cfe5134d713a536be9708c"}
Jul 15 22:17:31.830493 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.830428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k4n6n"]
Jul 15 22:17:31.831455 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:31.831433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2ncf8"]
Jul 15 22:17:31.837433 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:31.837408    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab3acd4_df38_4b05_8122_a00be2caeefd.slice/crio-3c04bcbeeebe2dadd3466c37652138659c90f95cd521bbdc8f7aea29692b47ae WatchSource:0}: Error finding container 3c04bcbeeebe2dadd3466c37652138659c90f95cd521bbdc8f7aea29692b47ae: Status 404 returned error can't find the container with id 3c04bcbeeebe2dadd3466c37652138659c90f95cd521bbdc8f7aea29692b47ae
Jul 15 22:17:31.838403 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:17:31.838374    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8bbad1_8e24_4788_93df_b46a425dd4a0.slice/crio-4ecfb4366e8694d2e0a087018f9c1864d935040aab3075cfe0cd01b048487f95 WatchSource:0}: Error finding container 4ecfb4366e8694d2e0a087018f9c1864d935040aab3075cfe0cd01b048487f95: Status 404 returned error can't find the container with id 4ecfb4366e8694d2e0a087018f9c1864d935040aab3075cfe0cd01b048487f95
Jul 15 22:17:32.684393 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:32.684353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4n6n" event={"ID":"3ab3acd4-df38-4b05-8122-a00be2caeefd","Type":"ContainerStarted","Data":"3c04bcbeeebe2dadd3466c37652138659c90f95cd521bbdc8f7aea29692b47ae"}
Jul 15 22:17:32.694421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:32.694325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"483ca0314eb012babcd3fd0e9e671d9b6d0a444a22f856234965bf3812864bfb"}
Jul 15 22:17:32.696857 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:32.696815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ncf8" event={"ID":"bd8bbad1-8e24-4788-93df-b46a425dd4a0","Type":"ContainerStarted","Data":"4ecfb4366e8694d2e0a087018f9c1864d935040aab3075cfe0cd01b048487f95"}
Jul 15 22:17:32.837106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:32.837071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:32.937126 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:32.936983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:33.036646 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:33.036616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:33.708070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:33.708025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c8dc" event={"ID":"7c541bf9-c370-4af5-a454-1755a1903793","Type":"ContainerStarted","Data":"49c2d9fbe0ed6d5f50ab624c03e122fa93867453b7dee52f0b73de401fc9f26d"}
Jul 15 22:17:33.862484 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:33.862446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:33.962152 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:33.962025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:34.024174 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:34.024141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:34.715770 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:34.715728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6c8dc" event={"ID":"7c541bf9-c370-4af5-a454-1755a1903793","Type":"ContainerStarted","Data":"a995b90d89e195b7d0cf1de2f45b9d3cc289ae0479732bee5d62777448c3f55d"}
Jul 15 22:17:34.743724 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:34.742739    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6c8dc" podStartSLOduration=67.141165042 podStartE2EDuration="1m8.742641128s" totalImagesPullingTime="1.601476086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:34.742488806 +0000 UTC m=+69.982406564" watchObservedRunningTime="2026-07-15 22:17:34.742641128 +0000 UTC m=+69.982558887"
Jul 15 22:17:34.843677 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:34.843644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:34.916940 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:34.916907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:37.729594 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:37.729546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2ncf8" event={"ID":"bd8bbad1-8e24-4788-93df-b46a425dd4a0","Type":"ContainerStarted","Data":"1c51ca6418c4db8b5945aaa4898e531551ebb6ed2148281354eabcc034da5df6"}
Jul 15 22:17:37.729964 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:37.729752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:17:37.734096 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:37.734031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"6761088d92b95389c8a9057f7860b7ac1783bd57ca48cac8bd1ae6352c6a07fd"}
Jul 15 22:17:37.750468 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:37.750419    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2ncf8" podStartSLOduration=66.038631035 podStartE2EDuration="1m11.750400064s" totalImagesPullingTime="5.711769029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:37.749286814 +0000 UTC m=+72.989204573" watchObservedRunningTime="2026-07-15 22:17:37.750400064 +0000 UTC m=+72.990317824"
Jul 15 22:17:38.741714 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.741665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k4n6n" event={"ID":"3ab3acd4-df38-4b05-8122-a00be2caeefd","Type":"ContainerStarted","Data":"92f2e4447042f64ea97b0d8cc7c34b7a854ba0a75d8a5276a87fd05fde27bc9b"}
Jul 15 22:17:38.748638 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.748603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"d35b95481d5b17bd451577a474a62a0c3e95ac6f498c25f4e6c18c79f43b38a6"}
Jul 15 22:17:38.748782 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.748693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"1afd5b8cb65911dfb001189e2bcacd9d478eee651b7458e1b146a52e1b62b156"}
Jul 15 22:17:38.748782 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.748736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a94508ba-faba-44bb-8e32-093cfc409c43","Type":"ContainerStarted","Data":"130777818c248c7dc96f348911ed2d32d5a9a740b1503e2d55aa51e3ea295f6b"}
Jul 15 22:17:38.758653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.758606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k4n6n" podStartSLOduration=67.034493426 podStartE2EDuration="1m12.758590949s" totalImagesPullingTime="5.724097523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:38.757491899 +0000 UTC m=+73.997409658" watchObservedRunningTime="2026-07-15 22:17:38.758590949 +0000 UTC m=+73.998508706"
Jul 15 22:17:38.815720 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:38.815663    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.054799792 podStartE2EDuration="14.815642174s" totalImagesPullingTime="10.738770099s" totalInitContainerRuntime="22.072283ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:38.801176606 +0000 UTC m=+74.041094363" watchObservedRunningTime="2026-07-15 22:17:38.815642174 +0000 UTC m=+74.055559933"
Jul 15 22:17:40.221465 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:40.221429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:17:43.450716 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:43.450689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:43.451091 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:43.450740    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:17:50.910284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:50.910169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:17:50.969195 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:17:50.969154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:00.842236 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:00.842196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:01.044258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:01.044224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:03.455044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:03.454998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:18:03.458681 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:03.458660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-786df47645-njqg5"
Jul 15 22:18:08.750915 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:08.750881    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2ncf8"
Jul 15 22:18:25.221205 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:25.221174    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:18:25.241206 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:25.241182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:18:25.930461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:25.930432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 22:18:29.914997 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:29.914926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:37.906257 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:37.906215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:38.195645 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:38.195568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:40.026116 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:40.026065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:46.804189 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:46.804149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:46.950208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:46.950175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:47.063362 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:47.063292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:47.546150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:47.546119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:47.607699 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:47.607669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:53.452709 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:53.452678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:53.509925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:53.509894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:58.220572 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:58.220536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:58.283967 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:58.283934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:58.519570 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:58.519550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:59.106637 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:59.106606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:59.168473 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:59.168447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:18:59.904464 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:18:59.904420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:00.005860 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:00.005829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:05.034035 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:05.033982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:05.087771 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:05.087739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:09.206959 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:09.206928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:09.263476 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:09.263443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:09.325377 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:09.325345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:12.310867 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:12.310833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:20.920061 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:20.919971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:19:21.021372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:19:21.021344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:01.479254 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:01.479215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:05.318617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:05.318587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:05.500244 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:05.500216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:34.270899 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:34.270828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:35.718552 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:35.718519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:35.905952 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:35.905915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:39.099774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:39.099741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:39.484083 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:39.483985    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:40.348097 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:40.348064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:40.795736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:40.795704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:42.664364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:42.664330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:42.876033 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:42.875984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:50.247541 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:50.247467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:51.086757 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.086722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kds7t"]
Jul 15 22:20:51.088758 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.088740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.097210 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.097191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 22:20:51.097317 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.097243    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2blrw\""
Jul 15 22:20:51.098126 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.098108    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 22:20:51.131381 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.131361    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kds7t"]
Jul 15 22:20:51.159520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.159494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrj7s\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-kube-api-access-zrj7s\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.159615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.159522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.259892 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.259866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrj7s\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-kube-api-access-zrj7s\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.260225 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.259898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.274931 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.274914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrj7s\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-kube-api-access-zrj7s\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.275455 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.275440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/925ce76f-cba4-4c8e-82fd-f32d04f617b3-bound-sa-token\") pod \"cert-manager-55b4d954d5-kds7t\" (UID: \"925ce76f-cba4-4c8e-82fd-f32d04f617b3\") " pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.404954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.404905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kds7t"
Jul 15 22:20:51.480621 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.480592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:51.544879 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:51.544850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kds7t"]
Jul 15 22:20:51.547902 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:20:51.547877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod925ce76f_cba4_4c8e_82fd_f32d04f617b3.slice/crio-26f65c35fd02c18d7e84527857540f0113c8a7fd0e4ec9739db613d02fbdf5ec WatchSource:0}: Error finding container 26f65c35fd02c18d7e84527857540f0113c8a7fd0e4ec9739db613d02fbdf5ec: Status 404 returned error can't find the container with id 26f65c35fd02c18d7e84527857540f0113c8a7fd0e4ec9739db613d02fbdf5ec
Jul 15 22:20:52.035480 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:52.035455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:52.177736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:52.177688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:52.413420 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:52.409433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kds7t" event={"ID":"925ce76f-cba4-4c8e-82fd-f32d04f617b3","Type":"ContainerStarted","Data":"26f65c35fd02c18d7e84527857540f0113c8a7fd0e4ec9739db613d02fbdf5ec"}
Jul 15 22:20:55.420864 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:55.420828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kds7t" event={"ID":"925ce76f-cba4-4c8e-82fd-f32d04f617b3","Type":"ContainerStarted","Data":"043149962b95890f0227034938b2b85f344376651a35e30d28f423acd4ef3a1f"}
Jul 15 22:20:55.462357 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:55.462311    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kds7t" podStartSLOduration=1.5763810820000002 podStartE2EDuration="4.462297877s" totalImagesPullingTime="2.885916795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:20:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:20:55.462008712 +0000 UTC m=+270.701926469" watchObservedRunningTime="2026-07-15 22:20:55.462297877 +0000 UTC m=+270.702215636"
Jul 15 22:20:59.388935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:59.388905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:20:59.508917 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:20:59.508888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:01.494929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:01.494899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:13.698891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:13.698859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:13.880340 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:13.880307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:14.111475 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.111445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:14.483131 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.483051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:14.718655 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.718628    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"]
Jul 15 22:21:14.723698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.723678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.735170 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.735153    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 22:21:14.736191 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.736173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 22:21:14.736240 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.736209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5pwh8\""
Jul 15 22:21:14.737102 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.737087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 22:21:14.771348 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.771329    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 22:21:14.780495 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.780472    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:14.792589 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.792567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"]
Jul 15 22:21:14.828954 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.828930    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.829103 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.828958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.829103 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.828995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.829103 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.829065    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.829103 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.829085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx6ht\" (UniqueName: \"kubernetes.io/projected/1e205520-a4e6-4a5e-a91b-272e481d8ed8-kube-api-access-fx6ht\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930245 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930328 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930328 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930426 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx6ht\" (UniqueName: \"kubernetes.io/projected/1e205520-a4e6-4a5e-a91b-272e481d8ed8-kube-api-access-fx6ht\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930426 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.930671 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.930653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.932575 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.932552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e205520-a4e6-4a5e-a91b-272e481d8ed8-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.932652 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.932635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.932688 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.932679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e205520-a4e6-4a5e-a91b-272e481d8ed8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:14.962726 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:14.962702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx6ht\" (UniqueName: \"kubernetes.io/projected/1e205520-a4e6-4a5e-a91b-272e481d8ed8-kube-api-access-fx6ht\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-qcnfb\" (UID: \"1e205520-a4e6-4a5e-a91b-272e481d8ed8\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:15.038676 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.038652    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:15.088926 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.088892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:15.206109 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.206081    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"]
Jul 15 22:21:15.209477 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:21:15.209452    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e205520_a4e6_4a5e_a91b_272e481d8ed8.slice/crio-c027e89bb5e2bb2e8f113316fdeb2c088c69608510e69e225b6b019bfd5f56f3 WatchSource:0}: Error finding container c027e89bb5e2bb2e8f113316fdeb2c088c69608510e69e225b6b019bfd5f56f3: Status 404 returned error can't find the container with id c027e89bb5e2bb2e8f113316fdeb2c088c69608510e69e225b6b019bfd5f56f3
Jul 15 22:21:15.243597 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.243573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:15.391601 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.391537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:15.487215 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.487185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb" event={"ID":"1e205520-a4e6-4a5e-a91b-272e481d8ed8","Type":"ContainerStarted","Data":"c027e89bb5e2bb2e8f113316fdeb2c088c69608510e69e225b6b019bfd5f56f3"}
Jul 15 22:21:15.619677 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.619648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:15.778176 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:15.778147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:18.500768 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:18.500707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb" event={"ID":"1e205520-a4e6-4a5e-a91b-272e481d8ed8","Type":"ContainerStarted","Data":"901a9718959e35e740a80a91ee5221718b8ad06395da09eb88924b8dbdfe21a7"}
Jul 15 22:21:19.505885 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:19.505846    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e205520-a4e6-4a5e-a91b-272e481d8ed8" containerID="901a9718959e35e740a80a91ee5221718b8ad06395da09eb88924b8dbdfe21a7" exitCode=0
Jul 15 22:21:19.506206 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:19.505904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb" event={"ID":"1e205520-a4e6-4a5e-a91b-272e481d8ed8","Type":"ContainerDied","Data":"901a9718959e35e740a80a91ee5221718b8ad06395da09eb88924b8dbdfe21a7"}
Jul 15 22:21:20.512275 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:20.512240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb" event={"ID":"1e205520-a4e6-4a5e-a91b-272e481d8ed8","Type":"ContainerStarted","Data":"3076f1371375138edad6f4e8086af01e611c963bef7482034446c46e059dcaf7"}
Jul 15 22:21:20.512672 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:20.512337    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:20.545680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:20.545629    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb" podStartSLOduration=2.136382878 podStartE2EDuration="6.545613543s" totalImagesPullingTime="3.397950672s" totalInitContainerRuntime="1.011279993s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:20.543162599 +0000 UTC m=+295.783080359" watchObservedRunningTime="2026-07-15 22:21:20.545613543 +0000 UTC m=+295.785531306"
Jul 15 22:21:22.948615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:22.948585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:23.067328 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:23.067294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:24.239466 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:24.239424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:24.303594 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:24.303566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:25.196320 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:25.196291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:21:25.197578 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:25.197552    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:21:25.199555 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:25.199539    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 22:21:25.419339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:25.419226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:25.487463 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:25.487410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:28.855512 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:28.855474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:28.988850 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:28.988819    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:31.517566 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:31.517537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-qcnfb"
Jul 15 22:21:34.837423 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:34.837383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:35.248833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:35.248755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:36.217531 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.217493    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfj4r"]
Jul 15 22:21:36.220989 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.220965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.231633 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.231523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x9jxv\""
Jul 15 22:21:36.231740 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.231643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 22:21:36.251731 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.251707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfj4r"]
Jul 15 22:21:36.304716 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.304695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.304834 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.304753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fqm2\" (UniqueName: \"kubernetes.io/projected/68a61635-fe78-4c57-a97c-b43237fc51ee-kube-api-access-2fqm2\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.305763 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.305743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:36.406147 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.406115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.406278 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.406192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fqm2\" (UniqueName: \"kubernetes.io/projected/68a61635-fe78-4c57-a97c-b43237fc51ee-kube-api-access-2fqm2\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.406317 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:21:36.406273    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 22:21:36.406360 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:21:36.406352    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert podName:68a61635-fe78-4c57-a97c-b43237fc51ee nodeName:}" failed. No retries permitted until 2026-07-15 22:21:36.906333615 +0000 UTC m=+312.146251354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert") pod "odh-model-controller-7998c67dc4-hfj4r" (UID: "68a61635-fe78-4c57-a97c-b43237fc51ee") : secret "odh-model-controller-webhook-cert" not found
Jul 15 22:21:36.467317 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.467292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fqm2\" (UniqueName: \"kubernetes.io/projected/68a61635-fe78-4c57-a97c-b43237fc51ee-kube-api-access-2fqm2\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.546464 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.546435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:36.820703 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.820596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:36.912004 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.911970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:36.914395 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:36.914372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a61635-fe78-4c57-a97c-b43237fc51ee-cert\") pod \"odh-model-controller-7998c67dc4-hfj4r\" (UID: \"68a61635-fe78-4c57-a97c-b43237fc51ee\") " pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:37.132543 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:37.132459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:37.368628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:37.368597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hfj4r"]
Jul 15 22:21:37.369875 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:21:37.369853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a61635_fe78_4c57_a97c_b43237fc51ee.slice/crio-1756eea40df8c4e0a327c5cc0f96b1cc740d04ad69589befcdea7b4e758954d2 WatchSource:0}: Error finding container 1756eea40df8c4e0a327c5cc0f96b1cc740d04ad69589befcdea7b4e758954d2: Status 404 returned error can't find the container with id 1756eea40df8c4e0a327c5cc0f96b1cc740d04ad69589befcdea7b4e758954d2
Jul 15 22:21:37.371734 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:37.371711    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:21:37.573935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:37.573891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r" event={"ID":"68a61635-fe78-4c57-a97c-b43237fc51ee","Type":"ContainerStarted","Data":"1756eea40df8c4e0a327c5cc0f96b1cc740d04ad69589befcdea7b4e758954d2"}
Jul 15 22:21:37.881881 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:37.881778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:38.614658 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:38.614626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:40.589955 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:40.589924    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r" event={"ID":"68a61635-fe78-4c57-a97c-b43237fc51ee","Type":"ContainerStarted","Data":"c1ea7ce323f503fb3c5124ad8f49b6f8f0af3295abd0a5b8181baed1ac67c7dd"}
Jul 15 22:21:40.590422 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:40.590071    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:40.613279 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:40.613222    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r" podStartSLOduration=1.494751997 podStartE2EDuration="4.613204015s" totalImagesPullingTime="3.118452018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:40.612439672 +0000 UTC m=+315.852357430" watchObservedRunningTime="2026-07-15 22:21:40.613204015 +0000 UTC m=+315.853121774"
Jul 15 22:21:41.486373 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.486335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:41.539641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.539612    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-pkh4g"]
Jul 15 22:21:41.541646 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.541631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.546833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.545419    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 22:21:41.546833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.546488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 22:21:41.546833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.546641    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vngc6\""
Jul 15 22:21:41.546833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.546773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 22:21:41.546833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.546773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 22:21:41.558704 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.558677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-pkh4g"]
Jul 15 22:21:41.653333 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.653306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eb5a35-4db9-41e4-8397-6f3927e69174-tls-certs\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.653669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.653340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bwxl\" (UniqueName: \"kubernetes.io/projected/22eb5a35-4db9-41e4-8397-6f3927e69174-kube-api-access-8bwxl\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.653669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.653377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb5a35-4db9-41e4-8397-6f3927e69174-tmp\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.742500 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.742426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:41.754559 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.754535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eb5a35-4db9-41e4-8397-6f3927e69174-tls-certs\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.754680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.754569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bwxl\" (UniqueName: \"kubernetes.io/projected/22eb5a35-4db9-41e4-8397-6f3927e69174-kube-api-access-8bwxl\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.754680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.754599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb5a35-4db9-41e4-8397-6f3927e69174-tmp\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.756868 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.756839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eb5a35-4db9-41e4-8397-6f3927e69174-tmp\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.756993 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.756974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eb5a35-4db9-41e4-8397-6f3927e69174-tls-certs\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.767898 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.767877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bwxl\" (UniqueName: \"kubernetes.io/projected/22eb5a35-4db9-41e4-8397-6f3927e69174-kube-api-access-8bwxl\") pod \"kube-auth-proxy-8547df878-pkh4g\" (UID: \"22eb5a35-4db9-41e4-8397-6f3927e69174\") " pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.853664 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.853638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g"
Jul 15 22:21:41.994170 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:41.994147    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-pkh4g"]
Jul 15 22:21:41.996175 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:21:41.996149    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22eb5a35_4db9_41e4_8397_6f3927e69174.slice/crio-e3eae423565586c86a4f03065cf5845d142201ff948218e990e54fa0ba530e70 WatchSource:0}: Error finding container e3eae423565586c86a4f03065cf5845d142201ff948218e990e54fa0ba530e70: Status 404 returned error can't find the container with id e3eae423565586c86a4f03065cf5845d142201ff948218e990e54fa0ba530e70
Jul 15 22:21:42.598967 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:42.598933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g" event={"ID":"22eb5a35-4db9-41e4-8397-6f3927e69174","Type":"ContainerStarted","Data":"e3eae423565586c86a4f03065cf5845d142201ff948218e990e54fa0ba530e70"}
Jul 15 22:21:43.780895 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:43.780846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:44.033665 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:44.033567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:45.154690 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.154660    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"]
Jul 15 22:21:45.157332 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.157311    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.161408 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.161387    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 22:21:45.161520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.161502    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 22:21:45.162252 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.162236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 22:21:45.162344 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.162237    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 22:21:45.162344 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.162275    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 22:21:45.162344 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.162285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c4vsg\""
Jul 15 22:21:45.200363 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.200334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"]
Jul 15 22:21:45.284198 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.284173    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.284323 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.284209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6d532a8-66a4-4af4-a99d-d1827d47b85e-manager-config\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.284323 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.284231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.284323 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.284248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8pgx\" (UniqueName: \"kubernetes.io/projected/f6d532a8-66a4-4af4-a99d-d1827d47b85e-kube-api-access-n8pgx\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.385122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.385090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.385122 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.385125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6d532a8-66a4-4af4-a99d-d1827d47b85e-manager-config\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.385365 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.385148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.385365 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.385164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8pgx\" (UniqueName: \"kubernetes.io/projected/f6d532a8-66a4-4af4-a99d-d1827d47b85e-kube-api-access-n8pgx\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.385997 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.385970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f6d532a8-66a4-4af4-a99d-d1827d47b85e-manager-config\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.387728 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.387702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.387827 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.387763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6d532a8-66a4-4af4-a99d-d1827d47b85e-metrics-cert\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.403034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.402995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8pgx\" (UniqueName: \"kubernetes.io/projected/f6d532a8-66a4-4af4-a99d-d1827d47b85e-kube-api-access-n8pgx\") pod \"lws-controller-manager-79bbf4474c-hf6zk\" (UID: \"f6d532a8-66a4-4af4-a99d-d1827d47b85e\") " pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.466090 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.466039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:45.608177 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:21:45.608135    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d532a8_66a4_4af4_a99d_d1827d47b85e.slice/crio-50b14f99695c15a042f5bd66d95a6dde21230c7346eda15b5cbdd525492cbef7 WatchSource:0}: Error finding container 50b14f99695c15a042f5bd66d95a6dde21230c7346eda15b5cbdd525492cbef7: Status 404 returned error can't find the container with id 50b14f99695c15a042f5bd66d95a6dde21230c7346eda15b5cbdd525492cbef7
Jul 15 22:21:45.613646 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.613614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g" event={"ID":"22eb5a35-4db9-41e4-8397-6f3927e69174","Type":"ContainerStarted","Data":"23e731a3213a414157e4cd8883adaf27b4abc3c91c6144e97d6e3abd68dee508"}
Jul 15 22:21:45.614968 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.614945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk" event={"ID":"f6d532a8-66a4-4af4-a99d-d1827d47b85e","Type":"ContainerStarted","Data":"50b14f99695c15a042f5bd66d95a6dde21230c7346eda15b5cbdd525492cbef7"}
Jul 15 22:21:45.615265 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.615247    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"]
Jul 15 22:21:45.689598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:45.689558    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8547df878-pkh4g" podStartSLOduration=1.978925356 podStartE2EDuration="4.689544407s" totalImagesPullingTime="2.710619051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:45.687685581 +0000 UTC m=+320.927603338" watchObservedRunningTime="2026-07-15 22:21:45.689544407 +0000 UTC m=+320.929462164"
Jul 15 22:21:46.185732 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:46.185700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:48.026349 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:48.026315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:48.315647 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:48.315567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:49.632288 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:49.632249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk" event={"ID":"f6d532a8-66a4-4af4-a99d-d1827d47b85e","Type":"ContainerStarted","Data":"d19c730f25099ec402be9dd703dc6236ad8bb2bd5c90a39ad3fc4ab133ae4af5"}
Jul 15 22:21:49.632680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:49.632363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:21:49.786605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:49.786578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:50.125155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:50.125081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:50.295493 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:50.295463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:51.108247 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.108208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:51.396363 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.396289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:51.554155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.554124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:51.595791 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.595768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hfj4r"
Jul 15 22:21:51.614101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.614061    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk" podStartSLOduration=2.778425319 podStartE2EDuration="6.61404813s" totalImagesPullingTime="3.835622811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:49.665911618 +0000 UTC m=+324.905829376" watchObservedRunningTime="2026-07-15 22:21:51.61404813 +0000 UTC m=+326.853965888"
Jul 15 22:21:51.702570 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.702506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:21:51.779258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:21:51.779231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:22:00.637688 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:22:00.637659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79bbf4474c-hf6zk"
Jul 15 22:22:36.270388 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:22:36.270293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:22:36.356565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:22:36.356541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:22:36.488033 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:22:36.487982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:05.637940 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:05.637905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:06.278371 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:06.278334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:06.915375 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:06.915345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:07.104257 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:07.104231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:10.806929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:10.806897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:13.246366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:13.246323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:14.087588 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:14.087556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:14.206888 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:14.206856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:17.481552 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:17.481520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:17.722943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:17.722907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:20.266589 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:20.266557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:20.359236 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:20.359205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:20.461465 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:20.461427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:20.564508 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:20.564422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:24.279573 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:24.279531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:24.383312 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:24.383278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:26.352848 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.352814    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"]
Jul 15 22:23:26.356129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.356108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.358668 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.358645    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 22:23:26.358774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.358673    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-klg4c\""
Jul 15 22:23:26.358774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.358737    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 22:23:26.358774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.358673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 22:23:26.359287 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.359273    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 22:23:26.363249 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.363221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:26.367798 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.367779    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"]
Jul 15 22:23:26.435498 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.435469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:26.514929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.514887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9ebc8c-0948-4179-88c6-19343e7eb682-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.514929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.514934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b9ebc8c-0948-4179-88c6-19343e7eb682-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.515159 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.515057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7tt\" (UniqueName: \"kubernetes.io/projected/2b9ebc8c-0948-4179-88c6-19343e7eb682-kube-api-access-tp7tt\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.615471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.615400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b9ebc8c-0948-4179-88c6-19343e7eb682-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.615596 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.615464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7tt\" (UniqueName: \"kubernetes.io/projected/2b9ebc8c-0948-4179-88c6-19343e7eb682-kube-api-access-tp7tt\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.615596 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.615531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9ebc8c-0948-4179-88c6-19343e7eb682-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.615996 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.615973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2b9ebc8c-0948-4179-88c6-19343e7eb682-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.617799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.617779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2b9ebc8c-0948-4179-88c6-19343e7eb682-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.627732 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.627707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7tt\" (UniqueName: \"kubernetes.io/projected/2b9ebc8c-0948-4179-88c6-19343e7eb682-kube-api-access-tp7tt\") pod \"kuadrant-console-plugin-66b5774985-vrjx2\" (UID: \"2b9ebc8c-0948-4179-88c6-19343e7eb682\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.664875 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.664851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"
Jul 15 22:23:26.797850 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.797819    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2"]
Jul 15 22:23:26.803110 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:23:26.803079    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b9ebc8c_0948_4179_88c6_19343e7eb682.slice/crio-13bb9bf98aed7d7792426f16482c28dcd21949f0c10d4f67a92290b5866b898e WatchSource:0}: Error finding container 13bb9bf98aed7d7792426f16482c28dcd21949f0c10d4f67a92290b5866b898e: Status 404 returned error can't find the container with id 13bb9bf98aed7d7792426f16482c28dcd21949f0c10d4f67a92290b5866b898e
Jul 15 22:23:26.990614 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:26.990538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2" event={"ID":"2b9ebc8c-0948-4179-88c6-19343e7eb682","Type":"ContainerStarted","Data":"13bb9bf98aed7d7792426f16482c28dcd21949f0c10d4f67a92290b5866b898e"}
Jul 15 22:23:29.905382 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:29.905354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:30.037102 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:30.037062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:36.349842 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.349809    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"]
Jul 15 22:23:36.359055 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.359007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.362101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.362079    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8xls\""
Jul 15 22:23:36.370057 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.370029    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"]
Jul 15 22:23:36.399444 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.399413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.399554 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.399468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjvf\" (UniqueName: \"kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.459797 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.459764    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"]
Jul 15 22:23:36.460097 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:36.460073    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-qbjvf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6"
Jul 15 22:23:36.500827 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.500789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.501000 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.500849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjvf\" (UniqueName: \"kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.501298 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.501275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:36.512485 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:36.512459    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjvf\" (UniqueName: \"kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.012924 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.012890    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"]
Jul 15 22:23:37.023468 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.023429    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"]
Jul 15 22:23:37.041109 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.041082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.043489 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:37.043453    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.053629 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.053566    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.057392 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:37.057350    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.097920 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.097772    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:37.104393 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.104364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.107196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.106844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbjvf\" (UniqueName: \"kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf\") pod \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") "
Jul 15 22:23:37.107196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.106954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume\") pod \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\" (UID: \"7f78f730-8527-4e62-9262-7ccd3b51a1d6\") "
Jul 15 22:23:37.107402 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.107271    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7f78f730-8527-4e62-9262-7ccd3b51a1d6" (UID: "7f78f730-8527-4e62-9262-7ccd3b51a1d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:23:37.109283 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.109259    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf" (OuterVolumeSpecName: "kube-api-access-qbjvf") pod "7f78f730-8527-4e62-9262-7ccd3b51a1d6" (UID: "7f78f730-8527-4e62-9262-7ccd3b51a1d6"). InnerVolumeSpecName "kube-api-access-qbjvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:23:37.111142 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:37.111111    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:37.140727 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.140547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:37.208007 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.207972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z77g\" (UniqueName: \"kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.208197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.208034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.208197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.208122    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbjvf\" (UniqueName: \"kubernetes.io/projected/7f78f730-8527-4e62-9262-7ccd3b51a1d6-kube-api-access-qbjvf\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:23:37.208197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.208143    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f78f730-8527-4e62-9262-7ccd3b51a1d6-extensions-socket-volume\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:23:37.309200 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.309119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z77g\" (UniqueName: \"kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.309200 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.309172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.309550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.309524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.323035 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.322995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z77g\" (UniqueName: \"kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q8vp9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.356388 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.356360    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6" path="/var/lib/kubelet/pods/7f78f730-8527-4e62-9262-7ccd3b51a1d6/volumes"
Jul 15 22:23:37.426434 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.426388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:37.696031 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.695933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:37.826358 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:37.826321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:38.045308 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:38.045276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:38.050543 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:38.050510    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-48wf6\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="7f78f730-8527-4e62-9262-7ccd3b51a1d6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-48wf6"
Jul 15 22:23:41.195839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:41.195799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:41.306626 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:41.306586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:41.858062 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:41.858023    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:41.965381 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:41.965351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:42.457311 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:42.457271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:42.523227 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:42.523191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:46.250888 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:46.250846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:46.351169 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:46.351133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:49.357760 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:49.357676    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:49.949492 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:49.949460    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:49.954404 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:23:49.954380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f6a43b_f290_45dc_8a75_67ed41a79ee9.slice/crio-e5446d8d109bdd1be8bd380e55738f20d1210e5803e6739f2aefcb9ea38b1b46 WatchSource:0}: Error finding container e5446d8d109bdd1be8bd380e55738f20d1210e5803e6739f2aefcb9ea38b1b46: Status 404 returned error can't find the container with id e5446d8d109bdd1be8bd380e55738f20d1210e5803e6739f2aefcb9ea38b1b46
Jul 15 22:23:50.100886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:50.100797    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" event={"ID":"87f6a43b-f290-45dc-8a75-67ed41a79ee9","Type":"ContainerStarted","Data":"e5446d8d109bdd1be8bd380e55738f20d1210e5803e6739f2aefcb9ea38b1b46"}
Jul 15 22:23:51.012515 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:51.012481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:51.105842 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:51.105814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2" event={"ID":"2b9ebc8c-0948-4179-88c6-19343e7eb682","Type":"ContainerStarted","Data":"5477d25007f645e3d9d9c33e113962ac62ac6c119040c97410f79e825269940e"}
Jul 15 22:23:51.137865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:51.137816    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vrjx2" podStartSLOduration=1.736817802 podStartE2EDuration="25.137800508s" totalImagesPullingTime="23.400982706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:51.13629397 +0000 UTC m=+446.376211742" watchObservedRunningTime="2026-07-15 22:23:51.137800508 +0000 UTC m=+446.377718266"
Jul 15 22:23:51.226824 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:51.226792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:53.878405 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:53.878367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:54.676778 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:54.676744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:54.773867 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:54.773830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:56.128863 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:56.128832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" event={"ID":"87f6a43b-f290-45dc-8a75-67ed41a79ee9","Type":"ContainerStarted","Data":"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"}
Jul 15 22:23:56.129259 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:56.128903    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:56.129259 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:56.128906    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" podUID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" containerName="manager" containerID="cri-o://d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f" gracePeriod=10
Jul 15 22:23:56.156154 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:56.156100    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" podStartSLOduration=14.018882303 podStartE2EDuration="19.156080736s" totalImagesPullingTime="5.137198433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:56.154155548 +0000 UTC m=+451.394073307" watchObservedRunningTime="2026-07-15 22:23:56.156080736 +0000 UTC m=+451.395998495"
Jul 15 22:23:56.977484 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:56.977461    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:57.083546 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.083514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume\") pod \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") "
Jul 15 22:23:57.083684 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.083622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z77g\" (UniqueName: \"kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g\") pod \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\" (UID: \"87f6a43b-f290-45dc-8a75-67ed41a79ee9\") "
Jul 15 22:23:57.084063 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.084038    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87f6a43b-f290-45dc-8a75-67ed41a79ee9" (UID: "87f6a43b-f290-45dc-8a75-67ed41a79ee9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:23:57.085697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.085671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g" (OuterVolumeSpecName: "kube-api-access-4z77g") pod "87f6a43b-f290-45dc-8a75-67ed41a79ee9" (UID: "87f6a43b-f290-45dc-8a75-67ed41a79ee9"). InnerVolumeSpecName "kube-api-access-4z77g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:23:57.134402 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.134328    2565 generic.go:356] "Generic (PLEG): container finished" podID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" containerID="d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f" exitCode=0
Jul 15 22:23:57.134402 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.134371    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"
Jul 15 22:23:57.134402 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.134386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" event={"ID":"87f6a43b-f290-45dc-8a75-67ed41a79ee9","Type":"ContainerDied","Data":"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"}
Jul 15 22:23:57.134838 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.134438    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9" event={"ID":"87f6a43b-f290-45dc-8a75-67ed41a79ee9","Type":"ContainerDied","Data":"e5446d8d109bdd1be8bd380e55738f20d1210e5803e6739f2aefcb9ea38b1b46"}
Jul 15 22:23:57.134838 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.134469    2565 scope.go:117] "RemoveContainer" containerID="d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"
Jul 15 22:23:57.143304 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.143288    2565 scope.go:117] "RemoveContainer" containerID="d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"
Jul 15 22:23:57.143673 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:23:57.143639    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f\": container with ID starting with d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f not found: ID does not exist" containerID="d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"
Jul 15 22:23:57.143753 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.143680    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f"} err="failed to get container status \"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f\": rpc error: code = NotFound desc = could not find container \"d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f\": container with ID starting with d9122ecd04e30b55905da7bbedaef553645d0eda2e13b360b90fa20f7105bd9f not found: ID does not exist"
Jul 15 22:23:57.165126 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.165099    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:57.174692 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.174671    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q8vp9"]
Jul 15 22:23:57.184832 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.184814    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z77g\" (UniqueName: \"kubernetes.io/projected/87f6a43b-f290-45dc-8a75-67ed41a79ee9-kube-api-access-4z77g\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:23:57.184906 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.184835    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87f6a43b-f290-45dc-8a75-67ed41a79ee9-extensions-socket-volume\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:23:57.355615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.355586    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" path="/var/lib/kubelet/pods/87f6a43b-f290-45dc-8a75-67ed41a79ee9/volumes"
Jul 15 22:23:57.683634 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.683603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:23:57.795559 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:23:57.795527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:05.634986 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:05.634937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:05.806186 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:05.806152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:05.977104 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:05.977049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:06.102023 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:06.101929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:07.898832 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:07.898798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:27.439581 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.439538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:27.651509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.651477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:27.746162 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.746081    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:27.955272 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.955242    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:24:27.955529 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.955518    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" containerName="manager"
Jul 15 22:24:27.955570 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.955531    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" containerName="manager"
Jul 15 22:24:27.955602 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.955587    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f6a43b-f290-45dc-8a75-67ed41a79ee9" containerName="manager"
Jul 15 22:24:27.957671 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.957651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:27.960064 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.960044    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 22:24:27.967733 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.967711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:24:27.981420 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:27.981396    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:24:28.039089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.039068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxm8\" (UniqueName: \"kubernetes.io/projected/2b1addb6-8182-4556-8367-ebc15688ce93-kube-api-access-6kxm8\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.039190 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.039167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b1addb6-8182-4556-8367-ebc15688ce93-config-file\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.140479 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.140457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b1addb6-8182-4556-8367-ebc15688ce93-config-file\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.140569 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.140492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxm8\" (UniqueName: \"kubernetes.io/projected/2b1addb6-8182-4556-8367-ebc15688ce93-kube-api-access-6kxm8\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.141072 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.141055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b1addb6-8182-4556-8367-ebc15688ce93-config-file\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.150373 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.150349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxm8\" (UniqueName: \"kubernetes.io/projected/2b1addb6-8182-4556-8367-ebc15688ce93-kube-api-access-6kxm8\") pod \"limitador-limitador-54d6d988d5-g7fkx\" (UID: \"2b1addb6-8182-4556-8367-ebc15688ce93\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.267329 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.267300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:28.299590 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.299530    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:28.301992 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.301975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:28.304413 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.304393    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-55grm\""
Jul 15 22:24:28.312840 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.312815    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:28.341513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.341484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr9tn\" (UniqueName: \"kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn\") pod \"authorino-58cd955675-6bhbr\" (UID: \"df0624d5-ef8c-4178-8cc2-8ebda7876022\") " pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:28.356413 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.356353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:28.397443 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.397423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:24:28.399723 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:24:28.399687    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b1addb6_8182_4556_8367_ebc15688ce93.slice/crio-dbd7626e37c87c855ad3a807fb22898e5c47ada6d9e3066aa3e0ff657749bc61 WatchSource:0}: Error finding container dbd7626e37c87c855ad3a807fb22898e5c47ada6d9e3066aa3e0ff657749bc61: Status 404 returned error can't find the container with id dbd7626e37c87c855ad3a807fb22898e5c47ada6d9e3066aa3e0ff657749bc61
Jul 15 22:24:28.433551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.433516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:28.442736 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.442714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr9tn\" (UniqueName: \"kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn\") pod \"authorino-58cd955675-6bhbr\" (UID: \"df0624d5-ef8c-4178-8cc2-8ebda7876022\") " pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:28.451318 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.451299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr9tn\" (UniqueName: \"kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn\") pod \"authorino-58cd955675-6bhbr\" (UID: \"df0624d5-ef8c-4178-8cc2-8ebda7876022\") " pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:28.613958 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.613888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:28.751031 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:28.750981    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:28.753563 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:24:28.753534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf0624d5_ef8c_4178_8cc2_8ebda7876022.slice/crio-3207cb1dbd69b0f9fb97781281b24056fcd307db919d7ed50d3956e57b3be38c WatchSource:0}: Error finding container 3207cb1dbd69b0f9fb97781281b24056fcd307db919d7ed50d3956e57b3be38c: Status 404 returned error can't find the container with id 3207cb1dbd69b0f9fb97781281b24056fcd307db919d7ed50d3956e57b3be38c
Jul 15 22:24:29.266440 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:29.266404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx" event={"ID":"2b1addb6-8182-4556-8367-ebc15688ce93","Type":"ContainerStarted","Data":"dbd7626e37c87c855ad3a807fb22898e5c47ada6d9e3066aa3e0ff657749bc61"}
Jul 15 22:24:29.267627 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:29.267596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bhbr" event={"ID":"df0624d5-ef8c-4178-8cc2-8ebda7876022","Type":"ContainerStarted","Data":"3207cb1dbd69b0f9fb97781281b24056fcd307db919d7ed50d3956e57b3be38c"}
Jul 15 22:24:33.287439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.287398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bhbr" event={"ID":"df0624d5-ef8c-4178-8cc2-8ebda7876022","Type":"ContainerStarted","Data":"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"}
Jul 15 22:24:33.288843 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.288823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx" event={"ID":"2b1addb6-8182-4556-8367-ebc15688ce93","Type":"ContainerStarted","Data":"34c94aad3e807262eb196804de5a055fa803f519da9bd275a8aef5aaa7d13c3c"}
Jul 15 22:24:33.288950 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.288934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:33.304413 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.304366    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6bhbr" podStartSLOduration=1.414276734 podStartE2EDuration="5.304353541s" totalImagesPullingTime="3.890076807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:33.303476851 +0000 UTC m=+488.543394610" watchObservedRunningTime="2026-07-15 22:24:33.304353541 +0000 UTC m=+488.544271277"
Jul 15 22:24:33.327653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.327601    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx" podStartSLOduration=2.138481573 podStartE2EDuration="6.327586432s" totalImagesPullingTime="4.189104859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:24:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:24:33.323438924 +0000 UTC m=+488.563356683" watchObservedRunningTime="2026-07-15 22:24:33.327586432 +0000 UTC m=+488.567504190"
Jul 15 22:24:33.572869 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:33.572793    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:35.296439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:35.296392    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6bhbr" podUID="df0624d5-ef8c-4178-8cc2-8ebda7876022" containerName="authorino" containerID="cri-o://65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49" gracePeriod=30
Jul 15 22:24:35.533368 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:35.533344    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:35.605766 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:35.605688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr9tn\" (UniqueName: \"kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn\") pod \"df0624d5-ef8c-4178-8cc2-8ebda7876022\" (UID: \"df0624d5-ef8c-4178-8cc2-8ebda7876022\") "
Jul 15 22:24:35.607651 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:35.607621    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn" (OuterVolumeSpecName: "kube-api-access-mr9tn") pod "df0624d5-ef8c-4178-8cc2-8ebda7876022" (UID: "df0624d5-ef8c-4178-8cc2-8ebda7876022"). InnerVolumeSpecName "kube-api-access-mr9tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:24:35.707003 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:35.706970    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr9tn\" (UniqueName: \"kubernetes.io/projected/df0624d5-ef8c-4178-8cc2-8ebda7876022-kube-api-access-mr9tn\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:24:36.300964 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.300928    2565 generic.go:356] "Generic (PLEG): container finished" podID="df0624d5-ef8c-4178-8cc2-8ebda7876022" containerID="65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49" exitCode=0
Jul 15 22:24:36.301439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.300972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bhbr"
Jul 15 22:24:36.301439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.300973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bhbr" event={"ID":"df0624d5-ef8c-4178-8cc2-8ebda7876022","Type":"ContainerDied","Data":"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"}
Jul 15 22:24:36.301439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.301087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bhbr" event={"ID":"df0624d5-ef8c-4178-8cc2-8ebda7876022","Type":"ContainerDied","Data":"3207cb1dbd69b0f9fb97781281b24056fcd307db919d7ed50d3956e57b3be38c"}
Jul 15 22:24:36.301439 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.301113    2565 scope.go:117] "RemoveContainer" containerID="65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"
Jul 15 22:24:36.309209 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.308981    2565 scope.go:117] "RemoveContainer" containerID="65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"
Jul 15 22:24:36.309426 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:24:36.309400    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49\": container with ID starting with 65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49 not found: ID does not exist" containerID="65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"
Jul 15 22:24:36.309517 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.309437    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49"} err="failed to get container status \"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49\": rpc error: code = NotFound desc = could not find container \"65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49\": container with ID starting with 65b119c684db2bba3cb63b2fc416399355a0b930ca965f52dfb04758c91efe49 not found: ID does not exist"
Jul 15 22:24:36.324039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.323680    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:36.328040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:36.327999    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bhbr"]
Jul 15 22:24:37.355486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:37.355451    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0624d5-ef8c-4178-8cc2-8ebda7876022" path="/var/lib/kubelet/pods/df0624d5-ef8c-4178-8cc2-8ebda7876022/volumes"
Jul 15 22:24:39.142624 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:39.142585    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:44.294227 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:44.294196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"
Jul 15 22:24:50.300184 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:50.300145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:50.398087 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:50.398046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:50.848725 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:50.848688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:51.979585 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:51.979538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:24:52.050289 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:24:52.050260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:04.175903 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.175868    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:04.280716 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.280685    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v5pbl"]
Jul 15 22:25:04.281000 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.280988    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0624d5-ef8c-4178-8cc2-8ebda7876022" containerName="authorino"
Jul 15 22:25:04.281059 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.281002    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0624d5-ef8c-4178-8cc2-8ebda7876022" containerName="authorino"
Jul 15 22:25:04.281093 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.281066    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0624d5-ef8c-4178-8cc2-8ebda7876022" containerName="authorino"
Jul 15 22:25:04.323787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.323758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v5pbl"]
Jul 15 22:25:04.323925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.323841    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:04.326442 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.326422    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-55grm\""
Jul 15 22:25:04.447808 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.447738    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbfqq\" (UniqueName: \"kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq\") pod \"authorino-5d4b67c446-v5pbl\" (UID: \"00f936f0-01fd-4ca4-bb7f-db01c614c60d\") " pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:04.487104 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.487068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:04.518002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.517969    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v5pbl"]
Jul 15 22:25:04.518280 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:25:04.518260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-nbfqq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-v5pbl" podUID="00f936f0-01fd-4ca4-bb7f-db01c614c60d"
Jul 15 22:25:04.548951 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.548921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbfqq\" (UniqueName: \"kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq\") pod \"authorino-5d4b67c446-v5pbl\" (UID: \"00f936f0-01fd-4ca4-bb7f-db01c614c60d\") " pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:04.560101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.560080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbfqq\" (UniqueName: \"kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq\") pod \"authorino-5d4b67c446-v5pbl\" (UID: \"00f936f0-01fd-4ca4-bb7f-db01c614c60d\") " pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:04.795113 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.795078    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:25:04.831072 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.831045    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:25:04.831224 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.831148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:04.833851 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.833830    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 22:25:04.951951 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.951923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9jk\" (UniqueName: \"kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:04.952111 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:04.951997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.052520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.052459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.052520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.052500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9jk\" (UniqueName: \"kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.054797 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.054778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.060743 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.060720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9jk\" (UniqueName: \"kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk\") pod \"authorino-74db9c6469-tkjmj\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") " pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.139947 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.139923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:25:05.275940 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.275916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:25:05.278314 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:25:05.278285    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8bf7213_3676_4399_9e2e_64351dccf88f.slice/crio-de7b0a2ccb69f76eb69fc859677347190f1d88a75c0686b8da9002ca74d3ab57 WatchSource:0}: Error finding container de7b0a2ccb69f76eb69fc859677347190f1d88a75c0686b8da9002ca74d3ab57: Status 404 returned error can't find the container with id de7b0a2ccb69f76eb69fc859677347190f1d88a75c0686b8da9002ca74d3ab57
Jul 15 22:25:05.415809 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.415739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74db9c6469-tkjmj" event={"ID":"f8bf7213-3676-4399-9e2e-64351dccf88f","Type":"ContainerStarted","Data":"de7b0a2ccb69f76eb69fc859677347190f1d88a75c0686b8da9002ca74d3ab57"}
Jul 15 22:25:05.415809 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.415772    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:05.455821 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.455794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:05.556447 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.556414    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbfqq\" (UniqueName: \"kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq\") pod \"00f936f0-01fd-4ca4-bb7f-db01c614c60d\" (UID: \"00f936f0-01fd-4ca4-bb7f-db01c614c60d\") "
Jul 15 22:25:05.558354 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.558328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq" (OuterVolumeSpecName: "kube-api-access-nbfqq") pod "00f936f0-01fd-4ca4-bb7f-db01c614c60d" (UID: "00f936f0-01fd-4ca4-bb7f-db01c614c60d"). InnerVolumeSpecName "kube-api-access-nbfqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:25:05.657844 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:05.657813    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbfqq\" (UniqueName: \"kubernetes.io/projected/00f936f0-01fd-4ca4-bb7f-db01c614c60d-kube-api-access-nbfqq\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:25:06.420151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:06.420119    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-v5pbl"
Jul 15 22:25:06.454990 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:06.454958    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v5pbl"]
Jul 15 22:25:06.456779 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:06.456754    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-v5pbl"]
Jul 15 22:25:07.358114 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:07.358084    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00f936f0-01fd-4ca4-bb7f-db01c614c60d" path="/var/lib/kubelet/pods/00f936f0-01fd-4ca4-bb7f-db01c614c60d/volumes"
Jul 15 22:25:07.425865 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:07.425831    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74db9c6469-tkjmj" event={"ID":"f8bf7213-3676-4399-9e2e-64351dccf88f","Type":"ContainerStarted","Data":"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"}
Jul 15 22:25:12.543190 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:12.543161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:12.641055 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:12.641005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:12.708107 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:12.708086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:16.329619 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:16.329579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:16.420124 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:16.420086    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:39.312050 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:39.311999    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:49.972028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:49.971984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:50.079639 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:50.079607    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:50.605749 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:50.605720    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:50.743275 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:50.743239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:51.129289 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:51.129257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:51.231006 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:51.230969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:25:51.727200 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:51.727143    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74db9c6469-tkjmj" podStartSLOduration=46.209264055 podStartE2EDuration="47.727127247s" totalImagesPullingTime="1.517863192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:25:07.446967538 +0000 UTC m=+522.686885294" watchObservedRunningTime="2026-07-15 22:25:51.727127247 +0000 UTC m=+566.967045008"
Jul 15 22:25:51.727939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:51.727918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:25:54.096783 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:25:54.096752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:01.012626 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:01.012577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:01.106197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:01.106163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:10.430731 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:10.430698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:11.071089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:11.071046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:11.505300 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:11.505225    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:26:18.132914 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:18.132879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:18.924231 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:18.924195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:26:25.221522 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:25.221494    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:26:25.221522 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:25.221521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:26:39.694702 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.694673    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"]
Jul 15 22:26:39.696921 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.696902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.700744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.700720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tckxd\""
Jul 15 22:26:39.700870 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.700762    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 22:26:39.700870 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.700733    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 22:26:39.701080 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.701065    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 22:26:39.717297 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.717277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"]
Jul 15 22:26:39.742714 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.742688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:39.825274 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1408706a-a109-406d-8cd8-7498b89e86e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.825387 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.825387 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.825472 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.825472 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbzj\" (UniqueName: \"kubernetes.io/projected/1408706a-a109-406d-8cd8-7498b89e86e9-kube-api-access-znbzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.825541 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.825484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.926775 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbzj\" (UniqueName: \"kubernetes.io/projected/1408706a-a109-406d-8cd8-7498b89e86e9-kube-api-access-znbzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.926886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.926886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926828    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1408706a-a109-406d-8cd8-7498b89e86e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.926886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.927071 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.927071 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.926954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.927272 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.927254    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.927341 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.927274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.927341 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.927306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.929160 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.929133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1408706a-a109-406d-8cd8-7498b89e86e9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.929385 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.929367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1408706a-a109-406d-8cd8-7498b89e86e9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:39.935146 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:39.935123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbzj\" (UniqueName: \"kubernetes.io/projected/1408706a-a109-406d-8cd8-7498b89e86e9-kube-api-access-znbzj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7pqns\" (UID: \"1408706a-a109-406d-8cd8-7498b89e86e9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:40.007264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:40.007207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:40.133300 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:40.133276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"]
Jul 15 22:26:40.135368 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:26:40.135340    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1408706a_a109_406d_8cd8_7498b89e86e9.slice/crio-82b0cd7d1f10336cdb36910052baf5b0cd520fe495bb01fd9656f76947fb3f43 WatchSource:0}: Error finding container 82b0cd7d1f10336cdb36910052baf5b0cd520fe495bb01fd9656f76947fb3f43: Status 404 returned error can't find the container with id 82b0cd7d1f10336cdb36910052baf5b0cd520fe495bb01fd9656f76947fb3f43
Jul 15 22:26:40.136768 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:40.136750    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:26:40.808623 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:40.808582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns" event={"ID":"1408706a-a109-406d-8cd8-7498b89e86e9","Type":"ContainerStarted","Data":"82b0cd7d1f10336cdb36910052baf5b0cd520fe495bb01fd9656f76947fb3f43"}
Jul 15 22:26:40.900952 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:40.900913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:26:41.813967 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:41.813929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns" event={"ID":"1408706a-a109-406d-8cd8-7498b89e86e9","Type":"ContainerStarted","Data":"436de5749a7ba13759b74e1e1b0851ed0a7c3bbde40922413e789d5ad5c04a58"}
Jul 15 22:26:41.833068 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:41.832999    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns" podStartSLOduration=1.8257138469999998 podStartE2EDuration="2.832983166s" totalImagesPullingTime="1.007269319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:26:41.832222284 +0000 UTC m=+617.072140067" watchObservedRunningTime="2026-07-15 22:26:41.832983166 +0000 UTC m=+617.072900939"
Jul 15 22:26:43.452427 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:43.452385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:43.552276 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:43.552243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:50.008266 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:50.008176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:50.008266 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:50.008245    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:50.020663 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:50.020641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:50.862264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:50.862237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7pqns"
Jul 15 22:26:54.214909 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:54.214877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:26:55.996709 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:26:55.996675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:27:08.337092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:08.337054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:27:10.838707 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:10.838668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:27:11.735446 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.735412    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"]
Jul 15 22:27:11.738669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.738643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.745685 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.745668    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 22:27:11.761413 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.761391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"]
Jul 15 22:27:11.776471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.776441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:27:11.787565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.787660 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.787711 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f621251-804a-4945-8c59-85459278db85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.787711 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.787840 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2p7d\" (UniqueName: \"kubernetes.io/projected/8f621251-804a-4945-8c59-85459278db85-kube-api-access-l2p7d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.787887 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.787868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.888725 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2p7d\" (UniqueName: \"kubernetes.io/projected/8f621251-804a-4945-8c59-85459278db85-kube-api-access-l2p7d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.888725 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f621251-804a-4945-8c59-85459278db85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.888986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.889232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.889247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.889511 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.889362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.890819 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.890801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f621251-804a-4945-8c59-85459278db85-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.891351 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.891331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f621251-804a-4945-8c59-85459278db85-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:11.901080 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:11.901052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2p7d\" (UniqueName: \"kubernetes.io/projected/8f621251-804a-4945-8c59-85459278db85-kube-api-access-l2p7d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt\" (UID: \"8f621251-804a-4945-8c59-85459278db85\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:12.047869 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:12.047821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:12.202044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:12.198503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"]
Jul 15 22:27:12.214931 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:27:12.214897    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f621251_804a_4945_8c59_85459278db85.slice/crio-206f93a59452568ae142287e237fcda91f4f11354a172c22d2e974040897bc10 WatchSource:0}: Error finding container 206f93a59452568ae142287e237fcda91f4f11354a172c22d2e974040897bc10: Status 404 returned error can't find the container with id 206f93a59452568ae142287e237fcda91f4f11354a172c22d2e974040897bc10
Jul 15 22:27:12.946738 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:12.946700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt" event={"ID":"8f621251-804a-4945-8c59-85459278db85","Type":"ContainerStarted","Data":"f9ce66f004d0454fbcc6ff5d6160a285d0335e79f6e0f3b5646ad2b46f2ff28f"}
Jul 15 22:27:12.946738 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:12.946744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt" event={"ID":"8f621251-804a-4945-8c59-85459278db85","Type":"ContainerStarted","Data":"206f93a59452568ae142287e237fcda91f4f11354a172c22d2e974040897bc10"}
Jul 15 22:27:12.969334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:12.968956    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt" podStartSLOduration=1.788117701 podStartE2EDuration="1.968934606s" totalImagesPullingTime="180.816905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:27:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:27:12.967213622 +0000 UTC m=+648.207131381" watchObservedRunningTime="2026-07-15 22:27:12.968934606 +0000 UTC m=+648.208852376"
Jul 15 22:27:19.814580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:19.814547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:27:22.048723 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:22.048681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:22.049135 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:22.048765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:22.061129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:22.061109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:27:22.998733 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:27:22.998707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt"
Jul 15 22:28:00.121707 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.121669    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c5bd55dfb-8tgdd"]
Jul 15 22:28:00.124053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.124008    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.134253 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.134227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5bd55dfb-8tgdd"]
Jul 15 22:28:00.215913 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.215886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d089c58-66a1-4d90-9330-1e1c19a8254e-tls-cert\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.216111 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.215948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk9gj\" (UniqueName: \"kubernetes.io/projected/8d089c58-66a1-4d90-9330-1e1c19a8254e-kube-api-access-wk9gj\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.316921 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.316890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d089c58-66a1-4d90-9330-1e1c19a8254e-tls-cert\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.317106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.316947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk9gj\" (UniqueName: \"kubernetes.io/projected/8d089c58-66a1-4d90-9330-1e1c19a8254e-kube-api-access-wk9gj\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.319187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.319164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8d089c58-66a1-4d90-9330-1e1c19a8254e-tls-cert\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.325274 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.325242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk9gj\" (UniqueName: \"kubernetes.io/projected/8d089c58-66a1-4d90-9330-1e1c19a8254e-kube-api-access-wk9gj\") pod \"authorino-5c5bd55dfb-8tgdd\" (UID: \"8d089c58-66a1-4d90-9330-1e1c19a8254e\") " pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.432411 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.432357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd"
Jul 15 22:28:00.568142 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.568114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:28:00.580981 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.580955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5bd55dfb-8tgdd"]
Jul 15 22:28:00.582844 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:28:00.582812    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d089c58_66a1_4d90_9330_1e1c19a8254e.slice/crio-4a089d4272e11a3bb7bfa6dd77dccbbdd18f520fb32690bd42f9d0231614d7dd WatchSource:0}: Error finding container 4a089d4272e11a3bb7bfa6dd77dccbbdd18f520fb32690bd42f9d0231614d7dd: Status 404 returned error can't find the container with id 4a089d4272e11a3bb7bfa6dd77dccbbdd18f520fb32690bd42f9d0231614d7dd
Jul 15 22:28:00.669582 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:00.669512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:28:01.147125 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:01.147091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd" event={"ID":"8d089c58-66a1-4d90-9330-1e1c19a8254e","Type":"ContainerStarted","Data":"4a089d4272e11a3bb7bfa6dd77dccbbdd18f520fb32690bd42f9d0231614d7dd"}
Jul 15 22:28:01.794615 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:01.794432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:28:02.047341 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.047245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:28:02.153517 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.153482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd" event={"ID":"8d089c58-66a1-4d90-9330-1e1c19a8254e","Type":"ContainerStarted","Data":"a306839138726739108cde5cfabd19bcdc22e0ba2007971151f93fa4af05d185"}
Jul 15 22:28:02.297046 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.296913    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c5bd55dfb-8tgdd" podStartSLOduration=1.663068338 podStartE2EDuration="2.296888835s" totalImagesPullingTime="633.820497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:28:02.200939443 +0000 UTC m=+697.440857202" watchObservedRunningTime="2026-07-15 22:28:02.296888835 +0000 UTC m=+697.536806594"
Jul 15 22:28:02.298856 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.298779    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:28:02.299026 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.298985    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-74db9c6469-tkjmj" podUID="f8bf7213-3676-4399-9e2e-64351dccf88f" containerName="authorino" containerID="cri-o://fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e" gracePeriod=30
Jul 15 22:28:02.559130 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.559071    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:28:02.643334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.643302    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz9jk\" (UniqueName: \"kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk\") pod \"f8bf7213-3676-4399-9e2e-64351dccf88f\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") "
Jul 15 22:28:02.643514 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.643347    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert\") pod \"f8bf7213-3676-4399-9e2e-64351dccf88f\" (UID: \"f8bf7213-3676-4399-9e2e-64351dccf88f\") "
Jul 15 22:28:02.645392 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.645364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk" (OuterVolumeSpecName: "kube-api-access-qz9jk") pod "f8bf7213-3676-4399-9e2e-64351dccf88f" (UID: "f8bf7213-3676-4399-9e2e-64351dccf88f"). InnerVolumeSpecName "kube-api-access-qz9jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:28:02.653088 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.653062    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f8bf7213-3676-4399-9e2e-64351dccf88f" (UID: "f8bf7213-3676-4399-9e2e-64351dccf88f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:28:02.744447 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.744399    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz9jk\" (UniqueName: \"kubernetes.io/projected/f8bf7213-3676-4399-9e2e-64351dccf88f-kube-api-access-qz9jk\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:28:02.744447 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:02.744442    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f8bf7213-3676-4399-9e2e-64351dccf88f-tls-cert\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:28:03.165417 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.165376    2565 generic.go:356] "Generic (PLEG): container finished" podID="f8bf7213-3676-4399-9e2e-64351dccf88f" containerID="fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e" exitCode=0
Jul 15 22:28:03.165852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.165428    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74db9c6469-tkjmj"
Jul 15 22:28:03.165852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.165455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74db9c6469-tkjmj" event={"ID":"f8bf7213-3676-4399-9e2e-64351dccf88f","Type":"ContainerDied","Data":"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"}
Jul 15 22:28:03.165852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.165503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74db9c6469-tkjmj" event={"ID":"f8bf7213-3676-4399-9e2e-64351dccf88f","Type":"ContainerDied","Data":"de7b0a2ccb69f76eb69fc859677347190f1d88a75c0686b8da9002ca74d3ab57"}
Jul 15 22:28:03.165852 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.165524    2565 scope.go:117] "RemoveContainer" containerID="fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"
Jul 15 22:28:03.175283 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.175269    2565 scope.go:117] "RemoveContainer" containerID="fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"
Jul 15 22:28:03.175539 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:28:03.175518    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e\": container with ID starting with fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e not found: ID does not exist" containerID="fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"
Jul 15 22:28:03.175595 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.175545    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e"} err="failed to get container status \"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e\": rpc error: code = NotFound desc = could not find container \"fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e\": container with ID starting with fb50d1fbd74550da388d3d0075fec052b26698eb03b9e8f6ecaef256ba0eba0e not found: ID does not exist"
Jul 15 22:28:03.200578 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.200549    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:28:03.207173 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.207151    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74db9c6469-tkjmj"]
Jul 15 22:28:03.356074 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:03.355992    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8bf7213-3676-4399-9e2e-64351dccf88f" path="/var/lib/kubelet/pods/f8bf7213-3676-4399-9e2e-64351dccf88f/volumes"
Jul 15 22:28:29.713028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:29.712974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:28:39.799246 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:39.799214    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:28:50.991987 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:50.991949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:28:59.200614 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:28:59.198581    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:29:04.296155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:04.296117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:29:09.996058 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:09.996008    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:29:12.671454 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:12.671423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:29:14.682523 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:14.682474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:29:38.103958 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:38.103925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:29:51.205191 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:51.205119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:29:55.466497 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:55.466457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:29:55.557243 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:55.557219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:29:55.699313 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:29:55.699271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:02.106929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:02.106888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:02.297008 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:02.296972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:02.508398 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:02.508328    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:02.619998 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:02.619965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:08.821734 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:08.821687    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:08.894303 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:08.894264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:26.597406 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:26.597372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:30:35.724562 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:35.724527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:30:45.523800 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:45.523763    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:30:47.296159 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:47.296117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:30:54.907833 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:30:54.907801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:31:07.515044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:07.514997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:31:16.770298 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:16.770262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:31:25.246382 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:25.246352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:31:25.247250 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:25.247230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:31:28.830708 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:28.830673    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:31:38.197989 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:31:38.197954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:32:07.017277 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:32:07.017238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:32:18.198945 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:32:18.198907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:32:41.616349 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:32:41.616307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:32:52.399765 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:32:52.399684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:33:06.897903 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:33:06.897863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:33:17.512284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:33:17.512245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:33:27.306552 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:33:27.306518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:33:36.389644 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:33:36.389610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:33:45.890332 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:33:45.890296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:34:18.197065 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:34:18.196977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:34:19.529737 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:34:19.529700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:34:50.889216 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:34:50.889183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:34:50.988595 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:34:50.988566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:35:36.402149 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:35:36.402119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:35:45.192111 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:35:45.192073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:35:59.511330 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:35:59.511257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:36:12.492452 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:12.492420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:36:23.886622 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:23.886587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:36:25.271484 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:25.271457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:36:25.272785 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:25.272761    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:36:33.297994 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:33.297963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:36:41.898242 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:41.898205    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:36:52.692830 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:36:52.692791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:37:03.898316 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:03.898285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:37:07.294446 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:07.294412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:37:12.992079 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:12.992040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:37:23.897179 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:23.897102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:37:45.787952 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:45.787916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:37:54.901551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:37:54.901513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:04.492030 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:04.491980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:15.898561 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:15.898524    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:23.793300 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:23.793266    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:35.296866 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:35.296831    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:47.100167 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:47.100075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:38:55.989409 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:38:55.989372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:05.878164 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:05.878125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:39:06.894478 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:06.894443    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:16.103849 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:16.103816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:24.891593 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:24.891555    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:37.893248 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:37.893207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:46.509834 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:46.509801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:39:56.397602 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:39:56.397562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:40:08.693886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:40:08.693852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:40:17.892951 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:40:17.892867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:40:24.607921 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:40:24.607887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:40:39.792763 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:40:39.792724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:40:51.394117 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:40:51.394081    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:03.795977 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:03.795945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:05.959248 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:05.959215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:10.456008 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:10.455969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:15.501281 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:15.501241    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:18.704079 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:18.704038    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:23.790499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:23.790457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:25.294652 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:25.294625    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:41:25.296331 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:25.296307    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:41:26.740815 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:26.740780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:26.840078 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:26.840042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:27.199263 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:27.199233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:27.701933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:27.701895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:32.981688 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:32.981647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:33.044230 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:33.044201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:33.200347 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:33.200311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:33.266611 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:33.266580    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:34.305664 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:34.305625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:34.404767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:34.404716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:34.548059 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:34.547996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:35.084895 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:35.084847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:35.183504 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:35.183475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:37.044044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:37.042080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:37.805391 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:37.805357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:49.927767 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:49.927689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:41:52.988339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:52.988304    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:41:54.502714 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:41:54.502663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:00.318474 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:00.318439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:00.417795 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:00.417767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:04.698548 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:04.698511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:05.040955 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:05.040916    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:05.143252 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:05.143220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:05.242945 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:05.242907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:06.554598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:06.554559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:06.882175 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:06.882091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:07.357949 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:07.357847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:07.540780 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:07.540743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:07.653296 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:07.653222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:11.325336 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:11.325291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:11.422778 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:11.422750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:11.493531 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:11.493467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:42:14.478058 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:14.478025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:42:17.314120 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:42:17.314075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:11.021335 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.021299    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"]
Jul 15 22:43:11.021876 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.021592    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bf7213-3676-4399-9e2e-64351dccf88f" containerName="authorino"
Jul 15 22:43:11.021876 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.021604    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bf7213-3676-4399-9e2e-64351dccf88f" containerName="authorino"
Jul 15 22:43:11.021876 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.021707    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8bf7213-3676-4399-9e2e-64351dccf88f" containerName="authorino"
Jul 15 22:43:11.024507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.024492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:11.027075 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.027046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:43:11.027175 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.027089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:43:11.036224 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.036199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"]
Jul 15 22:43:11.111028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.110981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:11.128076 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.128053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4\" (UID: \"69ee6aa2-7134-4a81-9567-f0a8619298ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:11.209922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.209891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:11.228774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.228751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4\" (UID: \"69ee6aa2-7134-4a81-9567-f0a8619298ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:11.229314 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.229297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4\" (UID: \"69ee6aa2-7134-4a81-9567-f0a8619298ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:11.334498 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.334446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:11.460556 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.460533    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"]
Jul 15 22:43:11.463241 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:43:11.463214    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ee6aa2_7134_4a81_9567_f0a8619298ed.slice/crio-720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865 WatchSource:0}: Error finding container 720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865: Status 404 returned error can't find the container with id 720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865
Jul 15 22:43:11.465210 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.465188    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 22:43:11.963159 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:11.963130    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4" event={"ID":"69ee6aa2-7134-4a81-9567-f0a8619298ed","Type":"ContainerStarted","Data":"720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865"}
Jul 15 22:43:13.992783 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:13.992754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:43:14.977338 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:14.977308    2565 generic.go:356] "Generic (PLEG): container finished" podID="69ee6aa2-7134-4a81-9567-f0a8619298ed" containerID="1fbf4075f39287cba506d7f90660a0f1cd95b8c41f8bd926c8768884abba7ffd" exitCode=0
Jul 15 22:43:14.977498 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:14.977395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4" event={"ID":"69ee6aa2-7134-4a81-9567-f0a8619298ed","Type":"ContainerDied","Data":"1fbf4075f39287cba506d7f90660a0f1cd95b8c41f8bd926c8768884abba7ffd"}
Jul 15 22:43:16.110553 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.110527    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:16.169576 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.169550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca\") pod \"69ee6aa2-7134-4a81-9567-f0a8619298ed\" (UID: \"69ee6aa2-7134-4a81-9567-f0a8619298ed\") "
Jul 15 22:43:16.169925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.169905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69ee6aa2-7134-4a81-9567-f0a8619298ed" (UID: "69ee6aa2-7134-4a81-9567-f0a8619298ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:43:16.271089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.271060    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69ee6aa2-7134-4a81-9567-f0a8619298ed-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:43:16.987542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.987514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4"
Jul 15 22:43:16.987698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.987542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4" event={"ID":"69ee6aa2-7134-4a81-9567-f0a8619298ed","Type":"ContainerDied","Data":"720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865"}
Jul 15 22:43:16.987698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:16.987583    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="720f27e95935c279b777254e0ac4087b75c5e614671defa3936f5c0e0afb1865"
Jul 15 22:43:17.067970 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:17.067893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:17.210894 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:17.210854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:17.802805 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:17.802763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:22.738753 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:22.738719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:22.927451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:22.927419    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:23.013560 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:23.013524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:24.181405 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:24.181372    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:24.270585 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:24.270558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:24.344654 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:24.344623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:24.445233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:24.445155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:25.036429 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:25.036396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:25.135837 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:25.135802    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:25.888600 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:25.888565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:43:26.705890 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:26.705859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:43:29.195987 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.195957    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:29.196371 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.196288    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ee6aa2-7134-4a81-9567-f0a8619298ed" containerName="revoke-keys"
Jul 15 22:43:29.196371 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.196300    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ee6aa2-7134-4a81-9567-f0a8619298ed" containerName="revoke-keys"
Jul 15 22:43:29.196371 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.196351    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="69ee6aa2-7134-4a81-9567-f0a8619298ed" containerName="revoke-keys"
Jul 15 22:43:29.199222 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.199205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:29.201624 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.201602    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:43:29.201752 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.201602    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:43:29.209007 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.208985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:29.366190 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.366156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s\" (UID: \"ef39090a-ef2b-4004-93b5-74521a16f0df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:29.466991 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.466924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s\" (UID: \"ef39090a-ef2b-4004-93b5-74521a16f0df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:29.467553 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.467534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s\" (UID: \"ef39090a-ef2b-4004-93b5-74521a16f0df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:29.509971 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.509945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:29.636451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:29.636426    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:29.638384 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:43:29.638339    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef39090a_ef2b_4004_93b5_74521a16f0df.slice/crio-e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750 WatchSource:0}: Error finding container e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750: Status 404 returned error can't find the container with id e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750
Jul 15 22:43:30.041532 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:30.041497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerStarted","Data":"9b2ab7c1174df0d2fe8e6a16787e29c29aea424f59543df96a619131c131ae6d"}
Jul 15 22:43:30.041668 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:30.041551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerStarted","Data":"e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750"}
Jul 15 22:43:30.057341 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:30.057294    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" podStartSLOduration=1.057278618 podStartE2EDuration="1.057278618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:43:30.055621298 +0000 UTC m=+1625.295539058" watchObservedRunningTime="2026-07-15 22:43:30.057278618 +0000 UTC m=+1625.297196380"
Jul 15 22:43:31.046776 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:31.046745    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerID="9b2ab7c1174df0d2fe8e6a16787e29c29aea424f59543df96a619131c131ae6d" exitCode=7
Jul 15 22:43:31.047155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:31.046789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerDied","Data":"9b2ab7c1174df0d2fe8e6a16787e29c29aea424f59543df96a619131c131ae6d"}
Jul 15 22:43:31.047155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:31.046973    2565 scope.go:117] "RemoveContainer" containerID="9b2ab7c1174df0d2fe8e6a16787e29c29aea424f59543df96a619131c131ae6d"
Jul 15 22:43:32.052907 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:32.052878    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerID="664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2" exitCode=7
Jul 15 22:43:32.053364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:32.052958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerDied","Data":"664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2"}
Jul 15 22:43:32.053364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:32.053036    2565 scope.go:117] "RemoveContainer" containerID="9b2ab7c1174df0d2fe8e6a16787e29c29aea424f59543df96a619131c131ae6d"
Jul 15 22:43:32.053364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:32.053212    2565 scope.go:117] "RemoveContainer" containerID="664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2"
Jul 15 22:43:32.053513 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:43:32.053439    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s_odh-ai-gateway-infra(ef39090a-ef2b-4004-93b5-74521a16f0df)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df"
Jul 15 22:43:33.058716 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:33.058691    2565 scope.go:117] "RemoveContainer" containerID="664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2"
Jul 15 22:43:33.059086 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:43:33.058850    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s_odh-ai-gateway-infra(ef39090a-ef2b-4004-93b5-74521a16f0df)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df"
Jul 15 22:43:44.351378 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:44.351352    2565 scope.go:117] "RemoveContainer" containerID="664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2"
Jul 15 22:43:45.111170 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:45.111146    2565 generic.go:356] "Generic (PLEG): container finished" podID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerID="f4b920508f25c1b6c24b362e667fa7b443ccecc170b3ef2ee54ad8a9f8527ada" exitCode=0
Jul 15 22:43:45.111292 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:45.111224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerDied","Data":"f4b920508f25c1b6c24b362e667fa7b443ccecc170b3ef2ee54ad8a9f8527ada"}
Jul 15 22:43:45.111351 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:45.111307    2565 scope.go:117] "RemoveContainer" containerID="664f4a68956563b7b5d7fa09c9acd55f3c6d00627da132d2cd9affccb328b3e2"
Jul 15 22:43:46.144537 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:46.144497    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:46.246090 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:46.246068    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:46.390939 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:46.390869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca\") pod \"ef39090a-ef2b-4004-93b5-74521a16f0df\" (UID: \"ef39090a-ef2b-4004-93b5-74521a16f0df\") "
Jul 15 22:43:46.391203 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:46.391182    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef39090a-ef2b-4004-93b5-74521a16f0df" (UID: "ef39090a-ef2b-4004-93b5-74521a16f0df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:43:46.491785 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:46.491760    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef39090a-ef2b-4004-93b5-74521a16f0df-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:43:47.123992 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.123953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s" event={"ID":"ef39090a-ef2b-4004-93b5-74521a16f0df","Type":"ContainerDied","Data":"e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750"}
Jul 15 22:43:47.123992 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.123987    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"
Jul 15 22:43:47.124245 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.124008    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e86628a68ce7a29b2aa9a3cc512f5a3b353537fad91cca2dd585bdbcd0060750"
Jul 15 22:43:47.159665 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.159639    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:47.164279 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.164257    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-mng5s"]
Jul 15 22:43:47.356508 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:43:47.356473    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" path="/var/lib/kubelet/pods/ef39090a-ef2b-4004-93b5-74521a16f0df/volumes"
Jul 15 22:44:14.749934 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:14.749898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:19.259901 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.259868    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"]
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260211    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260225    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260250    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260257    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260319    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.260483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.260331    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:19.262280 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.262264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:19.265662 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.265635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:44:19.265766 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.265664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:44:19.272347 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.272325    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"]
Jul 15 22:44:19.330090 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.330068    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb\" (UID: \"87d6b9e6-167a-45ab-af9d-9531937002d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:19.430961 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.430933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb\" (UID: \"87d6b9e6-167a-45ab-af9d-9531937002d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:19.431501 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.431484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb\" (UID: \"87d6b9e6-167a-45ab-af9d-9531937002d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:19.572131 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.572109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:19.902458 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:19.902366    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"]
Jul 15 22:44:19.905113 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:44:19.905086    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d6b9e6_167a_45ab_af9d_9531937002d8.slice/crio-c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699 WatchSource:0}: Error finding container c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699: Status 404 returned error can't find the container with id c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699
Jul 15 22:44:20.266768 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:20.266735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb" event={"ID":"87d6b9e6-167a-45ab-af9d-9531937002d8","Type":"ContainerStarted","Data":"86e22eddb2aba24b3e037aad0c780d10cb364994114531afdd1a5f3b4bbf9842"}
Jul 15 22:44:20.267117 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:20.266817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb" event={"ID":"87d6b9e6-167a-45ab-af9d-9531937002d8","Type":"ContainerStarted","Data":"c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699"}
Jul 15 22:44:20.286854 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:20.286812    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb" podStartSLOduration=1.286797768 podStartE2EDuration="1.286797768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:44:20.285228874 +0000 UTC m=+1675.525146644" watchObservedRunningTime="2026-07-15 22:44:20.286797768 +0000 UTC m=+1675.526715525"
Jul 15 22:44:21.272187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:21.272156    2565 generic.go:356] "Generic (PLEG): container finished" podID="87d6b9e6-167a-45ab-af9d-9531937002d8" containerID="86e22eddb2aba24b3e037aad0c780d10cb364994114531afdd1a5f3b4bbf9842" exitCode=0
Jul 15 22:44:21.272531 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:21.272203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb" event={"ID":"87d6b9e6-167a-45ab-af9d-9531937002d8","Type":"ContainerDied","Data":"86e22eddb2aba24b3e037aad0c780d10cb364994114531afdd1a5f3b4bbf9842"}
Jul 15 22:44:22.404112 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:22.404088    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:22.456275 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:22.456247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca\") pod \"87d6b9e6-167a-45ab-af9d-9531937002d8\" (UID: \"87d6b9e6-167a-45ab-af9d-9531937002d8\") "
Jul 15 22:44:22.456571 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:22.456548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87d6b9e6-167a-45ab-af9d-9531937002d8" (UID: "87d6b9e6-167a-45ab-af9d-9531937002d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:44:22.557605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:22.557549    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d6b9e6-167a-45ab-af9d-9531937002d8-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:44:23.280712 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:23.280690    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb"
Jul 15 22:44:23.280837 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:23.280711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb" event={"ID":"87d6b9e6-167a-45ab-af9d-9531937002d8","Type":"ContainerDied","Data":"c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699"}
Jul 15 22:44:23.280837 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:23.280752    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c468412c61c8df099ee6635d1eb3e6bfe24807d2027035e2c0263409741bd699"
Jul 15 22:44:30.183460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:30.183408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:33.011584 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:33.011551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:44:34.360092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:34.360034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:36.633461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:36.633420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:36.733719 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:36.733692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:40.379290 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:40.379261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:40.466974 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:40.466947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:45.443291 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:45.443254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:45.836229 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:45.836195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:47.006367 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:47.006329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:47.100387 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:47.100316    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:47.290490 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:47.290457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:47.442202 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:47.442170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:48.299512 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:48.299475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:48.409354 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:48.409314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:51.320793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.320761    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:44:51.321287 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321246    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d6b9e6-167a-45ab-af9d-9531937002d8" containerName="revoke-keys"
Jul 15 22:44:51.321287 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321265    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d6b9e6-167a-45ab-af9d-9531937002d8" containerName="revoke-keys"
Jul 15 22:44:51.321396 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321296    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:51.321396 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321305    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:51.321493 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321416    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef39090a-ef2b-4004-93b5-74521a16f0df" containerName="revoke-keys"
Jul 15 22:44:51.321493 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.321431    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d6b9e6-167a-45ab-af9d-9531937002d8" containerName="revoke-keys"
Jul 15 22:44:51.323425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.323406    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:44:51.326053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.326004    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:44:51.326181 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.326164    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:44:51.333280 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.333251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:44:51.485248 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.485223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns\" (UID: \"2df0269f-cb0c-4edf-8809-b10c3b620247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:44:51.586534 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.586478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns\" (UID: \"2df0269f-cb0c-4edf-8809-b10c3b620247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:44:51.586999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.586983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns\" (UID: \"2df0269f-cb0c-4edf-8809-b10c3b620247\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:44:51.633358 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.633336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:44:51.758959 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:51.758934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:44:51.761607 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:44:51.761580    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df0269f_cb0c_4edf_8809_b10c3b620247.slice/crio-03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca WatchSource:0}: Error finding container 03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca: Status 404 returned error can't find the container with id 03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca
Jul 15 22:44:52.117314 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.117280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:52.217840 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.217810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:44:52.400989 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.400962    2565 generic.go:356] "Generic (PLEG): container finished" podID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerID="8a687183d041943578eb9abca2e162032695cd769d9a8b9ebd68791707f2f589" exitCode=7
Jul 15 22:44:52.401288 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.400996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" event={"ID":"2df0269f-cb0c-4edf-8809-b10c3b620247","Type":"ContainerDied","Data":"8a687183d041943578eb9abca2e162032695cd769d9a8b9ebd68791707f2f589"}
Jul 15 22:44:52.401288 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.401054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" event={"ID":"2df0269f-cb0c-4edf-8809-b10c3b620247","Type":"ContainerStarted","Data":"03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca"}
Jul 15 22:44:52.401288 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:52.401226    2565 scope.go:117] "RemoveContainer" containerID="8a687183d041943578eb9abca2e162032695cd769d9a8b9ebd68791707f2f589"
Jul 15 22:44:53.407053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:53.407005    2565 generic.go:356] "Generic (PLEG): container finished" podID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerID="90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a" exitCode=7
Jul 15 22:44:53.407461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:53.407069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" event={"ID":"2df0269f-cb0c-4edf-8809-b10c3b620247","Type":"ContainerDied","Data":"90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a"}
Jul 15 22:44:53.407461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:53.407115    2565 scope.go:117] "RemoveContainer" containerID="8a687183d041943578eb9abca2e162032695cd769d9a8b9ebd68791707f2f589"
Jul 15 22:44:53.407461 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:53.407306    2565 scope.go:117] "RemoveContainer" containerID="90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a"
Jul 15 22:44:53.407597 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:44:53.407506    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns_odh-ai-gateway-infra(2df0269f-cb0c-4edf-8809-b10c3b620247)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247"
Jul 15 22:44:54.413258 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:54.413236    2565 scope.go:117] "RemoveContainer" containerID="90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a"
Jul 15 22:44:54.413596 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:44:54.413391    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns_odh-ai-gateway-infra(2df0269f-cb0c-4edf-8809-b10c3b620247)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247"
Jul 15 22:44:55.106804 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:55.106761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:44:55.802476 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:44:55.802439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:45:00.134835 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.134803    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"]
Jul 15 22:45:00.142945 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.142898    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"]
Jul 15 22:45:00.143293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.143265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"
Jul 15 22:45:00.146446 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.146420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"]
Jul 15 22:45:00.146567 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.146516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"
Jul 15 22:45:00.147315 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.147289    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"]
Jul 15 22:45:00.156614 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.156586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"
Jul 15 22:45:00.162644 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.162628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"
Jul 15 22:45:00.316805 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.316781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"]
Jul 15 22:45:00.318790 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:45:00.318761    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046c3da2_318f_48c7_a934_e800331e5645.slice/crio-036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89 WatchSource:0}: Error finding container 036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89: Status 404 returned error can't find the container with id 036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89
Jul 15 22:45:00.438510 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.438447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r" event={"ID":"046c3da2-318f-48c7-a934-e800331e5645","Type":"ContainerStarted","Data":"036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89"}
Jul 15 22:45:00.499025 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:00.498916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"]
Jul 15 22:45:00.500962 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:45:00.500944    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14ed9d3_a081_4041_a4cf_baaca5a84257.slice/crio-acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66 WatchSource:0}: Error finding container acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66: Status 404 returned error can't find the container with id acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66
Jul 15 22:45:01.443920 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:01.443890    2565 generic.go:356] "Generic (PLEG): container finished" podID="046c3da2-318f-48c7-a934-e800331e5645" containerID="abad2ff423f4591de06190a2e9ae469064a1ba0a26f3eb56aa07d5932b061e8b" exitCode=0
Jul 15 22:45:01.444311 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:01.443991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r" event={"ID":"046c3da2-318f-48c7-a934-e800331e5645","Type":"ContainerDied","Data":"abad2ff423f4591de06190a2e9ae469064a1ba0a26f3eb56aa07d5932b061e8b"}
Jul 15 22:45:01.445520 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:01.445499    2565 generic.go:356] "Generic (PLEG): container finished" podID="d14ed9d3-a081-4041-a4cf-baaca5a84257" containerID="0149349ec95e8cf5c6ad2f0b491dc03f6f794d4dbdaf19a336b1623bd9b8998b" exitCode=0
Jul 15 22:45:01.445630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:01.445530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj" event={"ID":"d14ed9d3-a081-4041-a4cf-baaca5a84257","Type":"ContainerDied","Data":"0149349ec95e8cf5c6ad2f0b491dc03f6f794d4dbdaf19a336b1623bd9b8998b"}
Jul 15 22:45:01.445630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:01.445587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj" event={"ID":"d14ed9d3-a081-4041-a4cf-baaca5a84257","Type":"ContainerStarted","Data":"acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66"}
Jul 15 22:45:02.579332 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:02.579307    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"
Jul 15 22:45:02.609128 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:02.609108    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"
Jul 15 22:45:03.454987 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.454961    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"
Jul 15 22:45:03.454987 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.454978    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj" event={"ID":"d14ed9d3-a081-4041-a4cf-baaca5a84257","Type":"ContainerDied","Data":"acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66"}
Jul 15 22:45:03.455159 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.455039    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acd390b48d039b673d0569075963a6ea54040875abf5528f492ce2d931afaa66"
Jul 15 22:45:03.456424 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.456403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r" event={"ID":"046c3da2-318f-48c7-a934-e800331e5645","Type":"ContainerDied","Data":"036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89"}
Jul 15 22:45:03.456551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.456441    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735925-c757r"
Jul 15 22:45:03.456551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:03.456445    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="036d8111cb8d28ed08111dc99b85b483ed4508c131e75ba18b00e100c5530e89"
Jul 15 22:45:05.352813 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:05.352788    2565 scope.go:117] "RemoveContainer" containerID="90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a"
Jul 15 22:45:06.470941 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:06.470868    2565 generic.go:356] "Generic (PLEG): container finished" podID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerID="7aa7e6adbf884ee32c81f561d596e60fb5fb6ebe2e474e702a46777d934e14ca" exitCode=0
Jul 15 22:45:06.471333 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:06.470944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" event={"ID":"2df0269f-cb0c-4edf-8809-b10c3b620247","Type":"ContainerDied","Data":"7aa7e6adbf884ee32c81f561d596e60fb5fb6ebe2e474e702a46777d934e14ca"}
Jul 15 22:45:06.471333 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:06.471000    2565 scope.go:117] "RemoveContainer" containerID="90e70a443171046d855ad411c0fd2a71ba329c18c2a58e2477313451acd6a94a"
Jul 15 22:45:07.513700 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:07.513667    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:45:07.606087 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:07.606063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:45:07.706691 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:07.706666    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca\") pod \"2df0269f-cb0c-4edf-8809-b10c3b620247\" (UID: \"2df0269f-cb0c-4edf-8809-b10c3b620247\") "
Jul 15 22:45:07.706985 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:07.706964    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2df0269f-cb0c-4edf-8809-b10c3b620247" (UID: "2df0269f-cb0c-4edf-8809-b10c3b620247"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:45:07.807977 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:07.807948    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2df0269f-cb0c-4edf-8809-b10c3b620247-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:45:08.482435 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:08.482408    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"
Jul 15 22:45:08.482574 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:08.482432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns" event={"ID":"2df0269f-cb0c-4edf-8809-b10c3b620247","Type":"ContainerDied","Data":"03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca"}
Jul 15 22:45:08.482574 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:08.482473    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03a0ce4eff59e70de4665708a9214f48cc800bba35a270fc2f4930845dd3ceca"
Jul 15 22:45:08.509884 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:08.509855    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:45:08.515680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:08.515661    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-nzhns"]
Jul 15 22:45:09.355847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:09.355813    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" path="/var/lib/kubelet/pods/2df0269f-cb0c-4edf-8809-b10c3b620247/volumes"
Jul 15 22:45:41.365428 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365399    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"]
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365687    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14ed9d3-a081-4041-a4cf-baaca5a84257" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365698    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14ed9d3-a081-4041-a4cf-baaca5a84257" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="046c3da2-318f-48c7-a934-e800331e5645" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365718    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="046c3da2-318f-48c7-a934-e800331e5645" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365727    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365739    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365744    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365752    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365757    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365807    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14ed9d3-a081-4041-a4cf-baaca5a84257" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365815    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365820    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365826    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="046c3da2-318f-48c7-a934-e800331e5645" containerName="cleanup"
Jul 15 22:45:41.365891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.365832    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2df0269f-cb0c-4edf-8809-b10c3b620247" containerName="revoke-keys"
Jul 15 22:45:41.367781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.367761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:41.370402 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.370382    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:45:41.370486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.370409    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:45:41.378585 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.378557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"]
Jul 15 22:45:41.455002 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.454974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk\" (UID: \"697fe0ce-9f2c-418c-8962-bc7e707606cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:41.555879 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.555860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk\" (UID: \"697fe0ce-9f2c-418c-8962-bc7e707606cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:41.556465 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.556447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk\" (UID: \"697fe0ce-9f2c-418c-8962-bc7e707606cf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:41.678805 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.678748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:41.800005 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:41.799955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"]
Jul 15 22:45:42.635417 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:42.635386    2565 generic.go:356] "Generic (PLEG): container finished" podID="697fe0ce-9f2c-418c-8962-bc7e707606cf" containerID="0c03a03df3273db5cca503a082e3818debc5e9de2ab856876fb228396be9bf1b" exitCode=0
Jul 15 22:45:42.635734 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:42.635433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk" event={"ID":"697fe0ce-9f2c-418c-8962-bc7e707606cf","Type":"ContainerDied","Data":"0c03a03df3273db5cca503a082e3818debc5e9de2ab856876fb228396be9bf1b"}
Jul 15 22:45:42.635734 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:42.635491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk" event={"ID":"697fe0ce-9f2c-418c-8962-bc7e707606cf","Type":"ContainerStarted","Data":"34da36b5cb78671df30ec5e060522f26126e8b6acdad54dab25811774ebe1df6"}
Jul 15 22:45:43.763275 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:43.763251    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:43.872278 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:43.872250    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca\") pod \"697fe0ce-9f2c-418c-8962-bc7e707606cf\" (UID: \"697fe0ce-9f2c-418c-8962-bc7e707606cf\") "
Jul 15 22:45:43.872608 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:43.872588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "697fe0ce-9f2c-418c-8962-bc7e707606cf" (UID: "697fe0ce-9f2c-418c-8962-bc7e707606cf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:45:43.973669 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:43.973617    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/697fe0ce-9f2c-418c-8962-bc7e707606cf-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:45:44.645331 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:44.645308    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk"
Jul 15 22:45:44.645460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:44.645349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk" event={"ID":"697fe0ce-9f2c-418c-8962-bc7e707606cf","Type":"ContainerDied","Data":"34da36b5cb78671df30ec5e060522f26126e8b6acdad54dab25811774ebe1df6"}
Jul 15 22:45:44.645460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:44.645392    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34da36b5cb78671df30ec5e060522f26126e8b6acdad54dab25811774ebe1df6"
Jul 15 22:45:51.950200 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:51.950164    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"]
Jul 15 22:45:51.953169 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:51.953134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:45:51.953313 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:51.953275    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-bf7f9845-29735925-p85sj"]
Jul 15 22:45:53.355924 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:53.355893    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14ed9d3-a081-4041-a4cf-baaca5a84257" path="/var/lib/kubelet/pods/d14ed9d3-a081-4041-a4cf-baaca5a84257/volumes"
Jul 15 22:45:54.594181 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:54.594148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:45:56.446630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:45:56.446586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:02.767443 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:02.767410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:02.844451 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:02.844424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:06.645110 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:06.645074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:07.274724 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:07.274683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:09.217108 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:09.217077    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:13.186449 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:13.186414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:14.643526 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:14.643492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:14.716162 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:14.716128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:14.829092 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:14.829063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:14.976819 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:14.976737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:15.395949 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:15.395924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:25.321596 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:25.321567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:46:25.324269 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:25.324248    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:46:41.307974 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:41.307936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:47.000844 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:47.000810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:47.130441 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:47.130389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:46:47.342379 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:46:47.342345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:03.116655 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:03.116616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:08.825486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:08.825440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:08.895386 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:08.895351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:08.985364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:08.985334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:19.561969 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:19.561935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:20.334089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:20.334057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:26.289911 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:26.289862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:26.352278 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:26.352247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:26.456769 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:26.456725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:26.656518 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:26.656431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:27.455343 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:27.455311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:27.555876 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:27.555843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:28.596509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:28.596470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:47:29.113459 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:29.113429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:35.129568 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:35.129526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:35.229425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:35.229390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:35.798042 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:35.797997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:37.955253 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:37.955219    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:47:41.829647 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:41.829609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:41.929546 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:41.929520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:42.029881 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:42.029853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:42.392111 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:42.392078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:42.689877 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:42.689807    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:45.429925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:45.429891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:45.527338 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:45.527303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:45.647886 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:45.647836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:46.098082 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:46.098044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:46.221902 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:46.221869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:46.332496 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:46.332465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:49.919039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:49.918936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:50.102063 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:50.102032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:47:50.565941 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:50.565908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:50.672349 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:50.672320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:51.368136 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:51.368108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:56.920237 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:56.920206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:57.021001 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.020957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:47:57.363787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.363760    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"]
Jul 15 22:47:57.364080 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.364068    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697fe0ce-9f2c-418c-8962-bc7e707606cf" containerName="revoke-keys"
Jul 15 22:47:57.364134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.364082    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="697fe0ce-9f2c-418c-8962-bc7e707606cf" containerName="revoke-keys"
Jul 15 22:47:57.364168 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.364134    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="697fe0ce-9f2c-418c-8962-bc7e707606cf" containerName="revoke-keys"
Jul 15 22:47:57.366974 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.366958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:47:57.374564 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.374545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:47:57.375539 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.375523    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:47:57.450564 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.450527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"]
Jul 15 22:47:57.466766 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.466741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9\" (UID: \"c8b0ec3f-aace-4303-b4fc-ee570f51421d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:47:57.568041 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.567999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9\" (UID: \"c8b0ec3f-aace-4303-b4fc-ee570f51421d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:47:57.568496 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.568477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9\" (UID: \"c8b0ec3f-aace-4303-b4fc-ee570f51421d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:47:57.677050 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.676998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:47:57.824055 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:47:57.824006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b0ec3f_aace_4303_b4fc_ee570f51421d.slice/crio-227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193 WatchSource:0}: Error finding container 227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193: Status 404 returned error can't find the container with id 227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193
Jul 15 22:47:57.824798 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:57.824775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"]
Jul 15 22:47:58.246065 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:58.246033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9" event={"ID":"c8b0ec3f-aace-4303-b4fc-ee570f51421d","Type":"ContainerStarted","Data":"bb14ba9563106f68b8ea49eaee7eca1a46c144994e38bb4cebcb886192c94099"}
Jul 15 22:47:58.246357 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:58.246087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9" event={"ID":"c8b0ec3f-aace-4303-b4fc-ee570f51421d","Type":"ContainerStarted","Data":"227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193"}
Jul 15 22:47:58.263061 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:58.263001    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9" podStartSLOduration=1.262987085 podStartE2EDuration="1.262987085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:47:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:47:58.261383755 +0000 UTC m=+1893.501301513" watchObservedRunningTime="2026-07-15 22:47:58.262987085 +0000 UTC m=+1893.502904892"
Jul 15 22:47:59.252604 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:59.252569    2565 generic.go:356] "Generic (PLEG): container finished" podID="c8b0ec3f-aace-4303-b4fc-ee570f51421d" containerID="bb14ba9563106f68b8ea49eaee7eca1a46c144994e38bb4cebcb886192c94099" exitCode=0
Jul 15 22:47:59.252965 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:47:59.252654    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9" event={"ID":"c8b0ec3f-aace-4303-b4fc-ee570f51421d","Type":"ContainerDied","Data":"bb14ba9563106f68b8ea49eaee7eca1a46c144994e38bb4cebcb886192c94099"}
Jul 15 22:48:00.380944 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:00.380916    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:48:00.392680 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:00.392661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca\") pod \"c8b0ec3f-aace-4303-b4fc-ee570f51421d\" (UID: \"c8b0ec3f-aace-4303-b4fc-ee570f51421d\") "
Jul 15 22:48:00.393000 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:00.392981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8b0ec3f-aace-4303-b4fc-ee570f51421d" (UID: "c8b0ec3f-aace-4303-b4fc-ee570f51421d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:48:00.494031 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:00.493989    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b0ec3f-aace-4303-b4fc-ee570f51421d-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:48:01.262823 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:01.262787    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9" event={"ID":"c8b0ec3f-aace-4303-b4fc-ee570f51421d","Type":"ContainerDied","Data":"227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193"}
Jul 15 22:48:01.262823 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:01.262825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9"
Jul 15 22:48:01.263075 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:01.262840    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="227798cbf6aaf23610d127fa09e2ab4161f1560fc0daf5bfae6dd683a90a9193"
Jul 15 22:48:08.049175 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:08.049139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:10.793800 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:10.793766    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:48:12.470661 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:12.470628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:18.424150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:18.424107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:18.505731 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:18.505697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:23.133576 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:23.133532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:23.373463 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:23.373429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:23.493788 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:23.493702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:23.593950 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:23.593887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:23.701289 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:23.701253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:27.039069 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:27.039005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:27.093675 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:27.093638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:28.236551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:28.236501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:29.409214 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:29.409181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:29.515614 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:29.515583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:29.609496 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:29.609461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:29.761084 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:29.760972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:35.391345 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:35.391308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:35.459456 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:35.459427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:42.154549 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:42.154503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:42.533477 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:42.533439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:43.255616 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:43.255577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:45.667941 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:45.667898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:45.750106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:45.750061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:45.905750 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:45.905712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:46.339660 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:46.339630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:46.438731 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:46.438697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:46.595304 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:46.595211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:50.189336 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:50.189296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:48:51.995600 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:48:51.995561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:49:04.892532 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.892484    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:04.893007 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.892933    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b0ec3f-aace-4303-b4fc-ee570f51421d" containerName="revoke-keys"
Jul 15 22:49:04.893007 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.892950    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b0ec3f-aace-4303-b4fc-ee570f51421d" containerName="revoke-keys"
Jul 15 22:49:04.893151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.893076    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b0ec3f-aace-4303-b4fc-ee570f51421d" containerName="revoke-keys"
Jul 15 22:49:04.896053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.896031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898471 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898580 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jj5\" (UniqueName: \"kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898685 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.898685 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.898645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.899524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.899505    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-79ecefd7\"/\"kube-root-ca.crt\""
Jul 15 22:49:04.899524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.899515    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-79ecefd7\"/\"e2e-lifecycle-model-79ecefd7-kserve-self-signed-certs\""
Jul 15 22:49:04.899628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.899557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-79ecefd7\"/\"default-dockercfg-7m55n\""
Jul 15 22:49:04.899628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.899507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-79ecefd7\"/\"openshift-service-ca.crt\""
Jul 15 22:49:04.911154 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.911127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:04.999132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999286 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999286 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999286 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jj5\" (UniqueName: \"kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999286 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999286 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999560 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999624 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:04.999624 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:04.999611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:05.001377 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.001359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:05.001652 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.001632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:05.003099 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.003074    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:05.007797 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.007778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jj5\" (UniqueName: \"kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5\") pod \"e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") " pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:05.211324 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.211247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:05.340061 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.340037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:05.342073 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:49:05.342040    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb56f6610_45df_41ee_b081_8b1a67469342.slice/crio-f08cc5fcad59ad6792f36d712e14f0c9e4c8ef9842300d3e04f6dc7e1fc0e421 WatchSource:0}: Error finding container f08cc5fcad59ad6792f36d712e14f0c9e4c8ef9842300d3e04f6dc7e1fc0e421: Status 404 returned error can't find the container with id f08cc5fcad59ad6792f36d712e14f0c9e4c8ef9842300d3e04f6dc7e1fc0e421
Jul 15 22:49:05.568486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.568450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" event={"ID":"b56f6610-45df-41ee-b081-8b1a67469342","Type":"ContainerStarted","Data":"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"}
Jul 15 22:49:05.568679 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.568509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" event={"ID":"b56f6610-45df-41ee-b081-8b1a67469342","Type":"ContainerStarted","Data":"f08cc5fcad59ad6792f36d712e14f0c9e4c8ef9842300d3e04f6dc7e1fc0e421"}
Jul 15 22:49:05.585409 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:05.585368    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" podStartSLOduration=1.585353847 podStartE2EDuration="1.585353847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:49:05.583978361 +0000 UTC m=+1960.823896130" watchObservedRunningTime="2026-07-15 22:49:05.585353847 +0000 UTC m=+1960.825271604"
Jul 15 22:49:08.386730 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:08.386694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:49:15.211524 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:15.211490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:15.212006 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:15.211557    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:15.224251 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:15.224222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:15.631550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:15.631516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:20.398794 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:20.398715    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:49:23.243719 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.243683    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"]
Jul 15 22:49:23.247269 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.247249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:23.249662 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.249634    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:49:23.249662 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.249643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:49:23.258528 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.258488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"]
Jul 15 22:49:23.341410 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.341381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl\" (UID: \"602becfd-f631-4719-b4a4-0dc0ff501efc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:23.442841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.442798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl\" (UID: \"602becfd-f631-4719-b4a4-0dc0ff501efc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:23.443468 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.443449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl\" (UID: \"602becfd-f631-4719-b4a4-0dc0ff501efc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:23.559200 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.559172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:23.891125 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:23.891102    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"]
Jul 15 22:49:23.893213 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:49:23.893189    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602becfd_f631_4719_b4a4_0dc0ff501efc.slice/crio-abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089 WatchSource:0}: Error finding container abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089: Status 404 returned error can't find the container with id abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089
Jul 15 22:49:24.662447 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:24.662413    2565 generic.go:356] "Generic (PLEG): container finished" podID="602becfd-f631-4719-b4a4-0dc0ff501efc" containerID="47583034a2926937772d5aae8f1004662a148e9305f8b045792547b9495907cc" exitCode=0
Jul 15 22:49:24.662781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:24.662481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl" event={"ID":"602becfd-f631-4719-b4a4-0dc0ff501efc","Type":"ContainerDied","Data":"47583034a2926937772d5aae8f1004662a148e9305f8b045792547b9495907cc"}
Jul 15 22:49:24.662781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:24.662519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl" event={"ID":"602becfd-f631-4719-b4a4-0dc0ff501efc","Type":"ContainerStarted","Data":"abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089"}
Jul 15 22:49:25.794208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:25.794186    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:25.863074 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:25.863042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca\") pod \"602becfd-f631-4719-b4a4-0dc0ff501efc\" (UID: \"602becfd-f631-4719-b4a4-0dc0ff501efc\") "
Jul 15 22:49:25.863366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:25.863344    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "602becfd-f631-4719-b4a4-0dc0ff501efc" (UID: "602becfd-f631-4719-b4a4-0dc0ff501efc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:49:25.963906 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:25.963842    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/602becfd-f631-4719-b4a4-0dc0ff501efc-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:26.672432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:26.672400    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl"
Jul 15 22:49:26.672432 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:26.672420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl" event={"ID":"602becfd-f631-4719-b4a4-0dc0ff501efc","Type":"ContainerDied","Data":"abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089"}
Jul 15 22:49:26.672653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:26.672467    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abdc8e1be4709dcdd96cca0517ff65998533fea1f316bd928f6124c53cc8c089"
Jul 15 22:49:33.733133 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:33.733068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:36.389602 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:36.389553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:49:37.592746 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:37.592713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:37.697641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:37.697609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:38.352117 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:38.352078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:43.315384 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:43.315347    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:43.366626 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:43.366588    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:49:58.335544 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.335497    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" podUID="b56f6610-45df-41ee-b081-8b1a67469342" containerName="main" containerID="cri-o://987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8" gracePeriod=45
Jul 15 22:49:58.586259 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.586199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:58.747102 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747267 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747267 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747267 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27jj5\" (UniqueName: \"kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747268    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747352    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs\") pod \"b56f6610-45df-41ee-b081-8b1a67469342\" (UID: \"b56f6610-45df-41ee-b081-8b1a67469342\") "
Jul 15 22:49:58.747483 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747358    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache" (OuterVolumeSpecName: "model-cache") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:49:58.747628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747478    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:49:58.747628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home" (OuterVolumeSpecName: "home") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:49:58.747723 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747640    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.747723 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747662    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.747723 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.747677    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.749488 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.749461    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm" (OuterVolumeSpecName: "dshm") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:49:58.749584 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.749481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5" (OuterVolumeSpecName: "kube-api-access-27jj5") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "kube-api-access-27jj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:49:58.749584 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.749491    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b56f6610-45df-41ee-b081-8b1a67469342" (UID: "b56f6610-45df-41ee-b081-8b1a67469342"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:49:58.827979 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.827946    2565 generic.go:356] "Generic (PLEG): container finished" podID="b56f6610-45df-41ee-b081-8b1a67469342" containerID="987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8" exitCode=0
Jul 15 22:49:58.828132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.827991    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"
Jul 15 22:49:58.828132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.828049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" event={"ID":"b56f6610-45df-41ee-b081-8b1a67469342","Type":"ContainerDied","Data":"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"}
Jul 15 22:49:58.828132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.828096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc" event={"ID":"b56f6610-45df-41ee-b081-8b1a67469342","Type":"ContainerDied","Data":"f08cc5fcad59ad6792f36d712e14f0c9e4c8ef9842300d3e04f6dc7e1fc0e421"}
Jul 15 22:49:58.828132 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.828120    2565 scope.go:117] "RemoveContainer" containerID="987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"
Jul 15 22:49:58.837774 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.837756    2565 scope.go:117] "RemoveContainer" containerID="987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"
Jul 15 22:49:58.838032 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:49:58.838003    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8\": container with ID starting with 987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8 not found: ID does not exist" containerID="987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"
Jul 15 22:49:58.838088 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.838040    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8"} err="failed to get container status \"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8\": rpc error: code = NotFound desc = could not find container \"987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8\": container with ID starting with 987aca74b3080e69a684e288078f3fbead33dc44bfac349f69bd4bfec51f50f8 not found: ID does not exist"
Jul 15 22:49:58.849269 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.849238    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27jj5\" (UniqueName: \"kubernetes.io/projected/b56f6610-45df-41ee-b081-8b1a67469342-kube-api-access-27jj5\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.849350 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.849269    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b56f6610-45df-41ee-b081-8b1a67469342-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.849350 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.849285    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b56f6610-45df-41ee-b081-8b1a67469342-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:49:58.850812 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.850791    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:58.854178 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:58.854159    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-79ecefd7/e2e-lifecycle-model-79ecefd7-kserve-58ccf7f7f9-lntpc"]
Jul 15 22:49:59.356320 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:49:59.356286    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56f6610-45df-41ee-b081-8b1a67469342" path="/var/lib/kubelet/pods/b56f6610-45df-41ee-b081-8b1a67469342/volumes"
Jul 15 22:50:18.491429 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:18.491390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:19.982929 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:19.982885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:20.732376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:20.732338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:25.382116 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:25.382089    2565 scope.go:117] "RemoveContainer" containerID="f4b920508f25c1b6c24b362e667fa7b443ccecc170b3ef2ee54ad8a9f8527ada"
Jul 15 22:50:26.473989 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:26.473949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:26.550757 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:26.550725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:30.611732 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:30.611701    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:30.906193 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:30.906104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:31.885176 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:31.885076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:31.979287 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:31.979253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:32.072605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:32.072567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:32.817302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:32.817258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:32.915445 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:32.915410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:33.015079 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:33.015049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:34.296118 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:34.296080    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:50:34.441672 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:34.441636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:40.210691 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:40.210651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:40.311196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:40.311164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:40.903156 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:40.903119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:46.828709 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:46.828670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:46.929944 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:46.929907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:47.037916 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:47.037830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:47.898790 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:47.898755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:50:57.590413 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:57.590378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:50:57.916354 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:50:57.916267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:18.899275 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:18.899238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:24.799366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:24.799330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:24.896733 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:24.896700    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:25.163526 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.163447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:25.349243 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.349219    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:51:25.353106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.353085    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:51:25.403674 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.403643    2565 scope.go:117] "RemoveContainer" containerID="7aa7e6adbf884ee32c81f561d596e60fb5fb6ebe2e474e702a46777d934e14ca"
Jul 15 22:51:25.411233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.411215    2565 scope.go:117] "RemoveContainer" containerID="0149349ec95e8cf5c6ad2f0b491dc03f6f794d4dbdaf19a336b1623bd9b8998b"
Jul 15 22:51:25.543304 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.543271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:25.737044 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:25.736941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:28.598486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:28.598451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:28.694192 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:28.694156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:28.859066 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:28.858977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:29.053417 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:29.053377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:29.558180 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:29.558144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:29.655638 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:29.655595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:33.067952 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:33.067897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:33.402605 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:33.402528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:33.714845 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:33.714764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:33.881728 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:33.881698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:36.549086 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:36.549055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:51:36.738478 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:36.738439    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:36.921480 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:36.921390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:37.077069 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:37.077036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:37.292430 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:37.292394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:37.997801 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:37.997756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:38.119839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:38.119805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:41.078256 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:41.078221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:47.414805 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:47.414769    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:51:51.403709 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:51.403675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:51.502999 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:51.502959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:56.803266 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803232    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:51:56.803645 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803564    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56f6610-45df-41ee-b081-8b1a67469342" containerName="main"
Jul 15 22:51:56.803645 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803576    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56f6610-45df-41ee-b081-8b1a67469342" containerName="main"
Jul 15 22:51:56.803645 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803597    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="602becfd-f631-4719-b4a4-0dc0ff501efc" containerName="revoke-keys"
Jul 15 22:51:56.803645 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803604    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="602becfd-f631-4719-b4a4-0dc0ff501efc" containerName="revoke-keys"
Jul 15 22:51:56.803778 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803650    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="602becfd-f631-4719-b4a4-0dc0ff501efc" containerName="revoke-keys"
Jul 15 22:51:56.803778 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.803658    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b56f6610-45df-41ee-b081-8b1a67469342" containerName="main"
Jul 15 22:51:56.806761 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.806742    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.810207 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.810185    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-30c9f8\"/\"openshift-service-ca.crt\""
Jul 15 22:51:56.810207 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.810196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-30c9f8\"/\"default-dockercfg-d7v2r\""
Jul 15 22:51:56.810357 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.810214    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-30c9f8\"/\"kube-root-ca.crt\""
Jul 15 22:51:56.810357 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.810190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-30c9f8\"/\"test-model-30c9f8-kserve-self-signed-certs\""
Jul 15 22:51:56.817978 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.817958    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:51:56.894543 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.894504    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:56.929692 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.929839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929759    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.929839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.929839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.929960 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5jxj\" (UniqueName: \"kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:56.929960 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:56.929915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5jxj\" (UniqueName: \"kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030770 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030770 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030770 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.030770 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.031073 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.030991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.031073 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.031041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.031165 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.031084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.032810 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.032792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.033160 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.033145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.051319 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.051293    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5jxj\" (UniqueName: \"kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj\") pod \"test-model-30c9f8-kserve-57d87455d7-hkrwc\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") " pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.116138 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.116080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:51:57.247653 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.247623    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:51:57.248984 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:51:57.248956    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2151d342_4bf3_4eaf_99b2_8dd55f1e9f1d.slice/crio-433fc0fa0bd647909f38b380a555d3ced22a3fb793713abf9f7e53ff33ba6277 WatchSource:0}: Error finding container 433fc0fa0bd647909f38b380a555d3ced22a3fb793713abf9f7e53ff33ba6277: Status 404 returned error can't find the container with id 433fc0fa0bd647909f38b380a555d3ced22a3fb793713abf9f7e53ff33ba6277
Jul 15 22:51:57.367141 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.367054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" event={"ID":"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d","Type":"ContainerStarted","Data":"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"}
Jul 15 22:51:57.367141 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.367098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" event={"ID":"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d","Type":"ContainerStarted","Data":"433fc0fa0bd647909f38b380a555d3ced22a3fb793713abf9f7e53ff33ba6277"}
Jul 15 22:51:57.390604 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:57.390557    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" podStartSLOduration=1.390544024 podStartE2EDuration="1.390544024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:51:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:51:57.388832404 +0000 UTC m=+2132.628750161" watchObservedRunningTime="2026-07-15 22:51:57.390544024 +0000 UTC m=+2132.630461779"
Jul 15 22:51:58.981632 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:58.981592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:51:59.084506 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:51:59.084462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:00.153633 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:00.153598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:00.697565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:00.697533    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:52:07.116622 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:07.116588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:07.117121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:07.116641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:07.128908 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:07.128885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:07.424928 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:07.424841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:13.209944 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:13.209908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:52:21.105856 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.105773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:21.109167 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.109149    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.112259 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.112231    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7fdd49\"/\"test-model-7fdd49-kserve-self-signed-certs\""
Jul 15 22:52:21.112259 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.112247    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-7fdd49\"/\"default-dockercfg-rlspf\""
Jul 15 22:52:21.112427 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.112235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7fdd49\"/\"kube-root-ca.crt\""
Jul 15 22:52:21.112427 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.112237    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-7fdd49\"/\"openshift-service-ca.crt\""
Jul 15 22:52:21.120228 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.120196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:21.197891 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.197857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:21.255926 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.255898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.256062 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.255929    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.256062 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.256031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.256062 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.256053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.256171 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.256085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.256171 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.256101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdhb\" (UniqueName: \"kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.356787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.356787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.356787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357089 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.356834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdhb\" (UniqueName: \"kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357252 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.357231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357311 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.357255    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.357311 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.357290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.358895 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.358869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.359376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.359358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.364841 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.364820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdhb\" (UniqueName: \"kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb\") pod \"test-model-7fdd49-kserve-6dc4f64d97-ns2tn\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") " pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.419305 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.419277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:21.545744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:21.545717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:21.547957 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:52:21.547928    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod931ad01c_4857_4d4d_9f6d_9664f7462423.slice/crio-7b83be7b99aca298cdd9cbba376f85a8af00fb608065165bd0d47f9ef7f76e20 WatchSource:0}: Error finding container 7b83be7b99aca298cdd9cbba376f85a8af00fb608065165bd0d47f9ef7f76e20: Status 404 returned error can't find the container with id 7b83be7b99aca298cdd9cbba376f85a8af00fb608065165bd0d47f9ef7f76e20
Jul 15 22:52:22.477127 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:22.477092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" event={"ID":"931ad01c-4857-4d4d-9f6d-9664f7462423","Type":"ContainerStarted","Data":"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"}
Jul 15 22:52:22.477127 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:22.477132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" event={"ID":"931ad01c-4857-4d4d-9f6d-9664f7462423","Type":"ContainerStarted","Data":"7b83be7b99aca298cdd9cbba376f85a8af00fb608065165bd0d47f9ef7f76e20"}
Jul 15 22:52:22.495697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:22.495651    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" podStartSLOduration=1.4956368150000001 podStartE2EDuration="1.495636815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:52:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:52:22.493561494 +0000 UTC m=+2157.733479253" watchObservedRunningTime="2026-07-15 22:52:22.495636815 +0000 UTC m=+2157.735554573"
Jul 15 22:52:27.410167 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:27.410135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:52:31.420356 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:31.420312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:31.420811 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:31.420382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:31.432698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:31.432674    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:31.527707 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:31.527677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:39.680458 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:39.680421    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:52:39.709769 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:39.709736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:40.610185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:40.610149    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:40.635663 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:40.635630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:41.270148 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:41.270110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:41.372170 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:41.372129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:45.500332 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:45.500294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:52:51.408034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:51.407980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:54.702083 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:54.701995    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" podUID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" containerName="main" containerID="cri-o://7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00" gracePeriod=45
Jul 15 22:52:54.941760 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:54.941733    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:55.041424 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041607 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041607 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041516    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041607 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5jxj\" (UniqueName: \"kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041607 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041558    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041829 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041625    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs\") pod \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\" (UID: \"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d\") "
Jul 15 22:52:55.041829 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041652    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.041829 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.041928 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home" (OuterVolumeSpecName: "home") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.041928 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041895    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.041928 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.041908    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.043759 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.043737    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj" (OuterVolumeSpecName: "kube-api-access-r5jxj") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "kube-api-access-r5jxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:52:55.043759 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.043750    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:52:55.043867 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.043810    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm" (OuterVolumeSpecName: "dshm") pod "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" (UID: "2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.142741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.142701    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.142741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.142735    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5jxj\" (UniqueName: \"kubernetes.io/projected/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-kube-api-access-r5jxj\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.142741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.142748    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.142971 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.142760    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:55.624711 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.624623    2565 generic.go:356] "Generic (PLEG): container finished" podID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" containerID="7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00" exitCode=0
Jul 15 22:52:55.624711 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.624671    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"
Jul 15 22:52:55.624934 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.624709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" event={"ID":"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d","Type":"ContainerDied","Data":"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"}
Jul 15 22:52:55.624934 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.624756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc" event={"ID":"2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d","Type":"ContainerDied","Data":"433fc0fa0bd647909f38b380a555d3ced22a3fb793713abf9f7e53ff33ba6277"}
Jul 15 22:52:55.624934 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.624777    2565 scope.go:117] "RemoveContainer" containerID="7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"
Jul 15 22:52:55.632700 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.632669    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" podUID="931ad01c-4857-4d4d-9f6d-9664f7462423" containerName="main" containerID="cri-o://65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19" gracePeriod=45
Jul 15 22:52:55.633389 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.633367    2565 scope.go:117] "RemoveContainer" containerID="7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"
Jul 15 22:52:55.633625 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:52:55.633604    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00\": container with ID starting with 7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00 not found: ID does not exist" containerID="7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"
Jul 15 22:52:55.633689 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.633636    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00"} err="failed to get container status \"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00\": rpc error: code = NotFound desc = could not find container \"7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00\": container with ID starting with 7bad4a45fea27ba585a03e445d6268f8327dbcf97e6f2c0bfe7a569ff427ef00 not found: ID does not exist"
Jul 15 22:52:55.641196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.641176    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:52:55.645459 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.645438    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-30c9f8/test-model-30c9f8-kserve-57d87455d7-hkrwc"]
Jul 15 22:52:55.831499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.831465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:52:55.872198 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.872172    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:55.949134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949054    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949103    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cdhb\" (UniqueName: \"kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir\") pod \"931ad01c-4857-4d4d-9f6d-9664f7462423\" (UID: \"931ad01c-4857-4d4d-9f6d-9664f7462423\") "
Jul 15 22:52:55.949565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949467    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache" (OuterVolumeSpecName: "model-cache") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.949565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949480    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home" (OuterVolumeSpecName: "home") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.949565 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.949492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.951262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.951229    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm" (OuterVolumeSpecName: "dshm") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:52:55.951369 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.951294    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb" (OuterVolumeSpecName: "kube-api-access-6cdhb") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "kube-api-access-6cdhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:52:55.951369 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:55.951312    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "931ad01c-4857-4d4d-9f6d-9664f7462423" (UID: "931ad01c-4857-4d4d-9f6d-9664f7462423"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:52:56.049925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049889    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cdhb\" (UniqueName: \"kubernetes.io/projected/931ad01c-4857-4d4d-9f6d-9664f7462423-kube-api-access-6cdhb\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.049925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049914    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/931ad01c-4857-4d4d-9f6d-9664f7462423-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.049925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049924    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.049925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049933    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.050221 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049940    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.050221 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.049947    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/931ad01c-4857-4d4d-9f6d-9664f7462423-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:52:56.533863 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.531536    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:52:56.630583 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.630548    2565 generic.go:356] "Generic (PLEG): container finished" podID="931ad01c-4857-4d4d-9f6d-9664f7462423" containerID="65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19" exitCode=0
Jul 15 22:52:56.630583 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.630565    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"
Jul 15 22:52:56.630793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.630592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" event={"ID":"931ad01c-4857-4d4d-9f6d-9664f7462423","Type":"ContainerDied","Data":"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"}
Jul 15 22:52:56.630793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.630638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn" event={"ID":"931ad01c-4857-4d4d-9f6d-9664f7462423","Type":"ContainerDied","Data":"7b83be7b99aca298cdd9cbba376f85a8af00fb608065165bd0d47f9ef7f76e20"}
Jul 15 22:52:56.630793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.630661    2565 scope.go:117] "RemoveContainer" containerID="65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"
Jul 15 22:52:56.640095 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.640071    2565 scope.go:117] "RemoveContainer" containerID="65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"
Jul 15 22:52:56.640368 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:52:56.640348    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19\": container with ID starting with 65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19 not found: ID does not exist" containerID="65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"
Jul 15 22:52:56.640421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.640377    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19"} err="failed to get container status \"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19\": rpc error: code = NotFound desc = could not find container \"65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19\": container with ID starting with 65d154e46ce914abe4a96cc2bc145c47939fc18684bdee6827161e2c221c6f19 not found: ID does not exist"
Jul 15 22:52:56.656573 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.656546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:56.659417 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:56.659394    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-7fdd49/test-model-7fdd49-kserve-6dc4f64d97-ns2tn"]
Jul 15 22:52:57.356441 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:57.356410    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" path="/var/lib/kubelet/pods/2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d/volumes"
Jul 15 22:52:57.356821 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:52:57.356802    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="931ad01c-4857-4d4d-9f6d-9664f7462423" path="/var/lib/kubelet/pods/931ad01c-4857-4d4d-9f6d-9664f7462423/volumes"
Jul 15 22:53:02.292166 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:02.292126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:02.401980 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:02.401943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:03.584302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:03.584268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:03.685922 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:03.685892    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:06.593699 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.593667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:06.819555 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.819516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:06.929659 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929585    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"]
Jul 15 22:53:06.929893 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929881    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" containerName="main"
Jul 15 22:53:06.929935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929895    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" containerName="main"
Jul 15 22:53:06.929935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929906    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931ad01c-4857-4d4d-9f6d-9664f7462423" containerName="main"
Jul 15 22:53:06.929935 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929912    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="931ad01c-4857-4d4d-9f6d-9664f7462423" containerName="main"
Jul 15 22:53:06.930074 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929961    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="931ad01c-4857-4d4d-9f6d-9664f7462423" containerName="main"
Jul 15 22:53:06.930074 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.929975    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2151d342-4bf3-4eaf-99b2-8dd55f1e9f1d" containerName="main"
Jul 15 22:53:06.932744 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.932729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:06.936051 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.936008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:53:06.936188 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.936143    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:53:06.944318 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:06.944296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"]
Jul 15 22:53:07.047114 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.047079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz\" (UID: \"5634509b-ce9f-49c3-ae07-2981f730819e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:07.148045 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.147992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz\" (UID: \"5634509b-ce9f-49c3-ae07-2981f730819e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:07.148617 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.148596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz\" (UID: \"5634509b-ce9f-49c3-ae07-2981f730819e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:07.243470 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.243399    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:07.378517 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.378493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"]
Jul 15 22:53:07.380969 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:53:07.380938    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5634509b_ce9f_49c3_ae07_2981f730819e.slice/crio-eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68 WatchSource:0}: Error finding container eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68: Status 404 returned error can't find the container with id eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68
Jul 15 22:53:07.624150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.624119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:07.685052 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.685007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz" event={"ID":"5634509b-ce9f-49c3-ae07-2981f730819e","Type":"ContainerStarted","Data":"52d441418f1c87fa16f5c584d00b6a8c992d4678cdf9ea49badf3eb0ed529850"}
Jul 15 22:53:07.685201 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.685074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz" event={"ID":"5634509b-ce9f-49c3-ae07-2981f730819e","Type":"ContainerStarted","Data":"eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68"}
Jul 15 22:53:07.704032 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.703970    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz" podStartSLOduration=1.703955037 podStartE2EDuration="1.703955037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:07.702437568 +0000 UTC m=+2202.942355325" watchObservedRunningTime="2026-07-15 22:53:07.703955037 +0000 UTC m=+2202.943872795"
Jul 15 22:53:07.722428 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:07.722397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:08.690790 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:08.690750    2565 generic.go:356] "Generic (PLEG): container finished" podID="5634509b-ce9f-49c3-ae07-2981f730819e" containerID="52d441418f1c87fa16f5c584d00b6a8c992d4678cdf9ea49badf3eb0ed529850" exitCode=0
Jul 15 22:53:08.691204 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:08.690812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz" event={"ID":"5634509b-ce9f-49c3-ae07-2981f730819e","Type":"ContainerDied","Data":"52d441418f1c87fa16f5c584d00b6a8c992d4678cdf9ea49badf3eb0ed529850"}
Jul 15 22:53:09.821850 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:09.821828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:09.971613 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:09.971528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca\") pod \"5634509b-ce9f-49c3-ae07-2981f730819e\" (UID: \"5634509b-ce9f-49c3-ae07-2981f730819e\") "
Jul 15 22:53:09.971940 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:09.971917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5634509b-ce9f-49c3-ae07-2981f730819e" (UID: "5634509b-ce9f-49c3-ae07-2981f730819e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:53:10.072406 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:10.072367    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5634509b-ce9f-49c3-ae07-2981f730819e-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:53:10.700967 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:10.700938    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz"
Jul 15 22:53:10.701150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:10.700943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz" event={"ID":"5634509b-ce9f-49c3-ae07-2981f730819e","Type":"ContainerDied","Data":"eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68"}
Jul 15 22:53:10.701150 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:10.701061    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb32bbeef0d53fcd8431a87e0402499cddb54df892fca97c407050b9f68cea68"
Jul 15 22:53:17.695155 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:17.695112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:21.205698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:21.205661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:53:22.013504 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:22.013465    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:27.881464 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:27.881428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:27.979429 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:27.979393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:32.695921 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:32.695886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:33.015505 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:33.015470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:33.257055 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:33.256995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:33.575040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:33.575004    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:34.001318 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:34.001212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:36.284668 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:36.284626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:36.398412 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:36.398365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:36.541347 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:36.541269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:36.888942 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:36.888865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:37.006990 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:37.006960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:37.107236 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:37.107204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:40.765755 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:40.765720    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:41.202136 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:41.202060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:53:41.224129 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:41.224097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:41.553638 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:41.553606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:41.649693 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:41.649656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:44.415338 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:44.415289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:44.505101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:44.505062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:44.716787 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:44.716713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:45.092262 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:45.092205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:45.250434 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:45.250405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:45.350749 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:45.350680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:48.865911 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:48.865824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:51.997894 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:51.997857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:53:56.907517 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.907485    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"]
Jul 15 22:53:56.907878 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.907785    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5634509b-ce9f-49c3-ae07-2981f730819e" containerName="revoke-keys"
Jul 15 22:53:56.907878 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.907795    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5634509b-ce9f-49c3-ae07-2981f730819e" containerName="revoke-keys"
Jul 15 22:53:56.907878 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.907840    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5634509b-ce9f-49c3-ae07-2981f730819e" containerName="revoke-keys"
Jul 15 22:53:56.910982 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.910965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:53:56.913341 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.913318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:53:56.913473 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.913356    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:53:56.918546 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:56.918520    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"]
Jul 15 22:53:57.045290 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.045263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl\" (UID: \"2b10a525-4aa4-4992-9c1b-a7456ede46de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:53:57.146504 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.146465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl\" (UID: \"2b10a525-4aa4-4992-9c1b-a7456ede46de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:53:57.147084 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.147066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl\" (UID: \"2b10a525-4aa4-4992-9c1b-a7456ede46de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:53:57.222696 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.222628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:53:57.362290 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.362264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"]
Jul 15 22:53:57.364360 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:53:57.364331    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b10a525_4aa4_4992_9c1b_a7456ede46de.slice/crio-fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03 WatchSource:0}: Error finding container fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03: Status 404 returned error can't find the container with id fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03
Jul 15 22:53:57.619282 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.619249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:57.715493 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.715459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:53:57.911120 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.911038    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl" event={"ID":"2b10a525-4aa4-4992-9c1b-a7456ede46de","Type":"ContainerStarted","Data":"ff606b8f58b3e5c8a5c85c4e98ada37f97c24c06ccce791db8b016b27acc98e2"}
Jul 15 22:53:57.911120 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.911112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl" event={"ID":"2b10a525-4aa4-4992-9c1b-a7456ede46de","Type":"ContainerStarted","Data":"fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03"}
Jul 15 22:53:57.927544 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:57.927500    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl" podStartSLOduration=1.927487181 podStartE2EDuration="1.927487181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:53:57.926447888 +0000 UTC m=+2253.166365645" watchObservedRunningTime="2026-07-15 22:53:57.927487181 +0000 UTC m=+2253.167404940"
Jul 15 22:53:58.917768 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:58.917737    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b10a525-4aa4-4992-9c1b-a7456ede46de" containerID="ff606b8f58b3e5c8a5c85c4e98ada37f97c24c06ccce791db8b016b27acc98e2" exitCode=0
Jul 15 22:53:58.918157 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:53:58.917824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl" event={"ID":"2b10a525-4aa4-4992-9c1b-a7456ede46de","Type":"ContainerDied","Data":"ff606b8f58b3e5c8a5c85c4e98ada37f97c24c06ccce791db8b016b27acc98e2"}
Jul 15 22:54:00.047911 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.047886    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:54:00.171116 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.171078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca\") pod \"2b10a525-4aa4-4992-9c1b-a7456ede46de\" (UID: \"2b10a525-4aa4-4992-9c1b-a7456ede46de\") "
Jul 15 22:54:00.171460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.171440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b10a525-4aa4-4992-9c1b-a7456ede46de" (UID: "2b10a525-4aa4-4992-9c1b-a7456ede46de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:00.272540 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.272516    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b10a525-4aa4-4992-9c1b-a7456ede46de-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:54:00.927997 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.927969    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl"
Jul 15 22:54:00.928171 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.928027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl" event={"ID":"2b10a525-4aa4-4992-9c1b-a7456ede46de","Type":"ContainerDied","Data":"fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03"}
Jul 15 22:54:00.928171 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:00.928073    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd69aa1849e280076ac0cd9ae2e3fff5baabea55b7756b9fc2c9e64a1ae8ab03"
Jul 15 22:54:06.151795 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:06.151760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:06.252003 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:06.251973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:07.514735 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:07.514703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:07.613741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:07.613714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:07.850230 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:07.850141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:09.798741 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:09.798707    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:54:11.995234 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:11.995201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:17.521819 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:17.521773    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:18.097243 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:18.097212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:18.198316 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:18.198288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:22.748910 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:22.748870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:22.949523 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:22.949482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:23.063410 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.063381    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"]
Jul 15 22:54:23.063720 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.063707    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b10a525-4aa4-4992-9c1b-a7456ede46de" containerName="revoke-keys"
Jul 15 22:54:23.063765 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.063722    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b10a525-4aa4-4992-9c1b-a7456ede46de" containerName="revoke-keys"
Jul 15 22:54:23.063799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.063795    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b10a525-4aa4-4992-9c1b-a7456ede46de" containerName="revoke-keys"
Jul 15 22:54:23.066857 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.066838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:23.069673 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.069655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 22:54:23.069764 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.069710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 22:54:23.077758 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.077736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"]
Jul 15 22:54:23.144482 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.144450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k\" (UID: \"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:23.245904 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.245872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k\" (UID: \"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:23.246616 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.246595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k\" (UID: \"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:23.377672 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.377606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:23.506630 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.506606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"]
Jul 15 22:54:23.508566 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:54:23.508530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fcb0cc_9cad_4f00_93af_3d5fb0d3c2f0.slice/crio-a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c WatchSource:0}: Error finding container a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c: Status 404 returned error can't find the container with id a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c
Jul 15 22:54:23.655718 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.655634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:23.768777 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:23.768741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:24.029183 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:24.029151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k" event={"ID":"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0","Type":"ContainerStarted","Data":"7f15070501687b974b9b4497f405073efc34e58696b370205deb1ac9fca575f4"}
Jul 15 22:54:24.029342 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:24.029213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k" event={"ID":"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0","Type":"ContainerStarted","Data":"a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c"}
Jul 15 22:54:24.048091 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:24.048042    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k" podStartSLOduration=1.048002576 podStartE2EDuration="1.048002576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:54:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:54:24.046469264 +0000 UTC m=+2279.286387045" watchObservedRunningTime="2026-07-15 22:54:24.048002576 +0000 UTC m=+2279.287920333"
Jul 15 22:54:25.035197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:25.035162    2565 generic.go:356] "Generic (PLEG): container finished" podID="c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0" containerID="7f15070501687b974b9b4497f405073efc34e58696b370205deb1ac9fca575f4" exitCode=0
Jul 15 22:54:25.035197 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:25.035201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k" event={"ID":"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0","Type":"ContainerDied","Data":"7f15070501687b974b9b4497f405073efc34e58696b370205deb1ac9fca575f4"}
Jul 15 22:54:26.171689 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:26.171663    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:26.275293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:26.275263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca\") pod \"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0\" (UID: \"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0\") "
Jul 15 22:54:26.275619 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:26.275594    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0" (UID: "c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 22:54:26.376127 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:26.376054    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:54:27.045475 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:27.045440    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k" event={"ID":"c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0","Type":"ContainerDied","Data":"a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c"}
Jul 15 22:54:27.045475 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:27.045460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k"
Jul 15 22:54:27.045760 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:27.045489    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a873d927ce2186415c9abbd46d5b59a2bacebdcb64513b1c9bc0235883af2b8c"
Jul 15 22:54:33.537872 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:33.537835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:36.698220 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:36.698181    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:54:38.176608 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:38.176571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:38.421933 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:38.421891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:38.523513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:38.523487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:44.091268 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:44.091217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:44.192529 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:44.192487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:48.912238 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:48.912205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:49.158694 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:49.158659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:49.500869 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:49.500839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:49.972022 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:49.971985    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:51.216426 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:51.216390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:52.667185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:52.667094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:52.745231 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:52.745203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:52.829706 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:52.829682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:53.321138 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:53.321104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:53.422117 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:53.422073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:53.528383 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:53.528359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:57.175921 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:57.175887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:57.504445 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:57.504349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:57.596866 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:57.596832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:54:57.850537 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:57.850494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:54:58.058946 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:54:58.058904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:00.710165 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:00.710130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:00.804353 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:00.804321    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:00.881086 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:00.881044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:01.040937 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:01.040910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:01.418395 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:01.418310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:01.515551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:01.515512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:05.201888 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:05.201850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:06.892283 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:06.892252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:55:14.278560 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:14.278520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:14.381856 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:14.381820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:19.089204 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.089131    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:55:19.089540 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.089457    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0" containerName="revoke-keys"
Jul 15 22:55:19.089540 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.089468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0" containerName="revoke-keys"
Jul 15 22:55:19.089540 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.089522    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0" containerName="revoke-keys"
Jul 15 22:55:19.092652 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.092632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.095781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.095758    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"kube-root-ca.crt\""
Jul 15 22:55:19.095781 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.095774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"auth-test-model-d5b2a8-kserve-self-signed-certs\""
Jul 15 22:55:19.095961 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.095767    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"default-dockercfg-n9q8x\""
Jul 15 22:55:19.095961 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.095785    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"openshift-service-ca.crt\""
Jul 15 22:55:19.100850 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.100825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:55:19.164894 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.164867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhqdb\" (UniqueName: \"kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.165040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.164904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.165040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.164933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.165040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.164970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.165040 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.164987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.165187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.165054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.185531 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.185499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:19.266123 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266092    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhqdb\" (UniqueName: \"kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266394 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266394 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266561 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266628 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.266676 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.266657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.268499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.268471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.268658 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.268637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.274426 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.274407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhqdb\" (UniqueName: \"kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb\") pod \"auth-test-model-d5b2a8-kserve-7459b59499-nkn4d\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") " pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.402861 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.402793    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:19.533310 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:19.533284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:55:19.535340 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:55:19.535308    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1e3c189_ddfd_4cf6_a312_40447d9eaff2.slice/crio-cdf4286325a717ff158bf8ebf0f5da2c5338e4aa2cbc05d12fdefdb0354dc63d WatchSource:0}: Error finding container cdf4286325a717ff158bf8ebf0f5da2c5338e4aa2cbc05d12fdefdb0354dc63d: Status 404 returned error can't find the container with id cdf4286325a717ff158bf8ebf0f5da2c5338e4aa2cbc05d12fdefdb0354dc63d
Jul 15 22:55:20.292695 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:20.292664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" event={"ID":"e1e3c189-ddfd-4cf6-a312-40447d9eaff2","Type":"ContainerStarted","Data":"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"}
Jul 15 22:55:20.293078 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:20.292702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" event={"ID":"e1e3c189-ddfd-4cf6-a312-40447d9eaff2","Type":"ContainerStarted","Data":"cdf4286325a717ff158bf8ebf0f5da2c5338e4aa2cbc05d12fdefdb0354dc63d"}
Jul 15 22:55:20.311551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:20.311487    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" podStartSLOduration=1.311473636 podStartE2EDuration="1.311473636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:55:20.310670146 +0000 UTC m=+2335.550587914" watchObservedRunningTime="2026-07-15 22:55:20.311473636 +0000 UTC m=+2335.551391396"
Jul 15 22:55:22.229620 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:22.229586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:22.335410 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:22.335370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:22.996499 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:22.996461    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:55:29.403802 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:29.403768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:29.404186 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:29.403821    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:29.416099 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:29.416079    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:30.354291 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:30.354264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:55:41.708501 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.708459    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:55:41.711729 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.711710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.715053 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.715028    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"openshift-service-ca.crt\""
Jul 15 22:55:41.715180 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.715054    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"kube-root-ca.crt\""
Jul 15 22:55:41.715180 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.715028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"default-dockercfg-slcv8\""
Jul 15 22:55:41.715180 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.715035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"auth-test-model-1e65bd-kserve-self-signed-certs\""
Jul 15 22:55:41.721358 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.721337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:55:41.735447 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.735420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:55:41.833370 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.833462 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.833462 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.833535 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz9xv\" (UniqueName: \"kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.833599 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.833640 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.833612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934707 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934791 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934791 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934791 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934905 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz9xv\" (UniqueName: \"kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.934905 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.934873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.935144 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.935125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.935219 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.935193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.935302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.935287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.936938 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.936922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.937227 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.937208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:41.945734 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:41.945714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz9xv\" (UniqueName: \"kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv\") pod \"auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") " pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:42.020756 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:42.020738    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:42.149325 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:42.149297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:55:42.150818 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:55:42.150785    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2515828c_5182_47d4_aef8_021b5b477da7.slice/crio-74c66d4426eba7845fc2d2685fc95c9a373d37345bc4d43ff66b346512033e6b WatchSource:0}: Error finding container 74c66d4426eba7845fc2d2685fc95c9a373d37345bc4d43ff66b346512033e6b: Status 404 returned error can't find the container with id 74c66d4426eba7845fc2d2685fc95c9a373d37345bc4d43ff66b346512033e6b
Jul 15 22:55:42.397636 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:42.397566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" event={"ID":"2515828c-5182-47d4-aef8-021b5b477da7","Type":"ContainerStarted","Data":"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"}
Jul 15 22:55:42.397636 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:42.397602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" event={"ID":"2515828c-5182-47d4-aef8-021b5b477da7","Type":"ContainerStarted","Data":"74c66d4426eba7845fc2d2685fc95c9a373d37345bc4d43ff66b346512033e6b"}
Jul 15 22:55:42.414220 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:42.414172    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" podStartSLOduration=1.41415743 podStartE2EDuration="1.41415743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:55:42.412688204 +0000 UTC m=+2357.652605974" watchObservedRunningTime="2026-07-15 22:55:42.41415743 +0000 UTC m=+2357.654075202"
Jul 15 22:55:44.402077 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:44.402040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:55:52.021095 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:52.021061    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:52.021469 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:52.021134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:52.033195 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:52.033173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:55:52.453318 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:55:52.453289    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:56:01.502533 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:01.502500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:56:14.700738 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:14.700704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:56:25.382370 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:25.382340    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:56:25.387144 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:25.387125    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 22:56:31.312238 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:31.312204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:56:35.339238 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:35.339196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:56:49.894135 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:56:49.894056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:57:07.701567 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:07.701529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:57:21.697761 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:21.697727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:57:35.679372 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:35.679336    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:57:35.695985 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:35.695949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:57:36.612334 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:36.612302    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:57:36.632780 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:36.632749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:57:40.192028 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:40.191986    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:57:42.002611 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.002581    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:57:42.006306 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.006286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.009034 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.009000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"sub-test-model-d5b2a8-kserve-self-signed-certs\""
Jul 15 22:57:42.017542 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.017517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:57:42.021884 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.021856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:57:42.155708 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.155817 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q57pz\" (UniqueName: \"kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.155817 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.155817 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.155925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.155925 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.155870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.256936 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.256884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.256936 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.256912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q57pz\" (UniqueName: \"kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.256936 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.256929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257142 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257186 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257233 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257278 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257347 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.257426 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.257407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.259364 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.259345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.259641 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.259619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.276648 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.276626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q57pz\" (UniqueName: \"kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz\") pod \"sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") " pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.319273 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.319250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:42.444942 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.444918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:57:42.446954 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:57:42.446923    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc72d3f27_c451_4acf_b0f4_5c559ab483a4.slice/crio-0fb21f517091ad25186c2f89363c3e8567d9f6442bfca16ff8550588f4dd1738 WatchSource:0}: Error finding container 0fb21f517091ad25186c2f89363c3e8567d9f6442bfca16ff8550588f4dd1738: Status 404 returned error can't find the container with id 0fb21f517091ad25186c2f89363c3e8567d9f6442bfca16ff8550588f4dd1738
Jul 15 22:57:42.955551 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.955517    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" event={"ID":"c72d3f27-c451-4acf-b0f4-5c559ab483a4","Type":"ContainerStarted","Data":"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"}
Jul 15 22:57:42.955740 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.955557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" event={"ID":"c72d3f27-c451-4acf-b0f4-5c559ab483a4","Type":"ContainerStarted","Data":"0fb21f517091ad25186c2f89363c3e8567d9f6442bfca16ff8550588f4dd1738"}
Jul 15 22:57:42.974786 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:42.974741    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" podStartSLOduration=1.974727511 podStartE2EDuration="1.974727511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:57:42.973565753 +0000 UTC m=+2478.213483511" watchObservedRunningTime="2026-07-15 22:57:42.974727511 +0000 UTC m=+2478.214645268"
Jul 15 22:57:50.699635 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.699575    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" podUID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" containerName="main" containerID="cri-o://63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76" gracePeriod=45
Jul 15 22:57:50.967269 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.967210    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:57:50.999609 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.999522    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" containerID="63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76" exitCode=0
Jul 15 22:57:50.999609 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.999570    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"
Jul 15 22:57:50.999853 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.999627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" event={"ID":"e1e3c189-ddfd-4cf6-a312-40447d9eaff2","Type":"ContainerDied","Data":"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"}
Jul 15 22:57:50.999853 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.999680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d" event={"ID":"e1e3c189-ddfd-4cf6-a312-40447d9eaff2","Type":"ContainerDied","Data":"cdf4286325a717ff158bf8ebf0f5da2c5338e4aa2cbc05d12fdefdb0354dc63d"}
Jul 15 22:57:50.999853 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:50.999703    2565 scope.go:117] "RemoveContainer" containerID="63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"
Jul 15 22:57:51.010473 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.010447    2565 scope.go:117] "RemoveContainer" containerID="63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"
Jul 15 22:57:51.010854 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:57:51.010827    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76\": container with ID starting with 63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76 not found: ID does not exist" containerID="63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"
Jul 15 22:57:51.010962 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.010864    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76"} err="failed to get container status \"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76\": rpc error: code = NotFound desc = could not find container \"63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76\": container with ID starting with 63464f2622021cf2c69db3a730eb9b377b571dec2c64ab02598446e8c653ae76 not found: ID does not exist"
Jul 15 22:57:51.011564 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.011539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:57:51.111792 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.111760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:57:51.124676 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124641    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124762 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124785    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhqdb\" (UniqueName: \"kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124871 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124817    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124871 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm\") pod \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\" (UID: \"e1e3c189-ddfd-4cf6-a312-40447d9eaff2\") "
Jul 15 22:57:51.124991 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:51.125078 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.124994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home" (OuterVolumeSpecName: "home") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:51.125134 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.125090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache" (OuterVolumeSpecName: "model-cache") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:51.125183 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.125164    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.125183 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.125177    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.125282 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.125192    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.126915 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.126886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm" (OuterVolumeSpecName: "dshm") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:51.127052 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.126913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb" (OuterVolumeSpecName: "kube-api-access-rhqdb") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "kube-api-access-rhqdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:57:51.127052 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.126986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e1e3c189-ddfd-4cf6-a312-40447d9eaff2" (UID: "e1e3c189-ddfd-4cf6-a312-40447d9eaff2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:57:51.226388 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.226325    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.226388 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.226349    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.226388 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.226359    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhqdb\" (UniqueName: \"kubernetes.io/projected/e1e3c189-ddfd-4cf6-a312-40447d9eaff2-kube-api-access-rhqdb\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:51.321343 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.321312    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:57:51.324995 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.324973    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/auth-test-model-d5b2a8-kserve-7459b59499-nkn4d"]
Jul 15 22:57:51.356657 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.356634    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" path="/var/lib/kubelet/pods/e1e3c189-ddfd-4cf6-a312-40447d9eaff2/volumes"
Jul 15 22:57:51.634198 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.634170    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" podUID="2515828c-5182-47d4-aef8-021b5b477da7" containerName="main" containerID="cri-o://69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2" gracePeriod=45
Jul 15 22:57:51.871920 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:51.871900    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:57:52.005187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.005117    2565 generic.go:356] "Generic (PLEG): container finished" podID="2515828c-5182-47d4-aef8-021b5b477da7" containerID="69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2" exitCode=0
Jul 15 22:57:52.005187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.005173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"
Jul 15 22:57:52.005376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.005206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" event={"ID":"2515828c-5182-47d4-aef8-021b5b477da7","Type":"ContainerDied","Data":"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"}
Jul 15 22:57:52.005376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.005251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx" event={"ID":"2515828c-5182-47d4-aef8-021b5b477da7","Type":"ContainerDied","Data":"74c66d4426eba7845fc2d2685fc95c9a373d37345bc4d43ff66b346512033e6b"}
Jul 15 22:57:52.005376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.005274    2565 scope.go:117] "RemoveContainer" containerID="69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"
Jul 15 22:57:52.013151 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.013134    2565 scope.go:117] "RemoveContainer" containerID="69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"
Jul 15 22:57:52.013401 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:57:52.013381    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2\": container with ID starting with 69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2 not found: ID does not exist" containerID="69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"
Jul 15 22:57:52.013466 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.013411    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2"} err="failed to get container status \"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2\": rpc error: code = NotFound desc = could not find container \"69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2\": container with ID starting with 69db0c1967811e731766b84859b43943cead0a58e0fd8f6024d13f1ba00a78e2 not found: ID does not exist"
Jul 15 22:57:52.032677 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032660    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.032761 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.032761 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz9xv\" (UniqueName: \"kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.032857 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.032857 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032774    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.032857 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.032799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm\") pod \"2515828c-5182-47d4-aef8-021b5b477da7\" (UID: \"2515828c-5182-47d4-aef8-021b5b477da7\") "
Jul 15 22:57:52.033100 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.033073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home" (OuterVolumeSpecName: "home") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:52.033100 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.033088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:52.033199 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.033100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:52.034797 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.034775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm" (OuterVolumeSpecName: "dshm") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:57:52.034906 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.034888    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:57:52.034957 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.034924    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv" (OuterVolumeSpecName: "kube-api-access-pz9xv") pod "2515828c-5182-47d4-aef8-021b5b477da7" (UID: "2515828c-5182-47d4-aef8-021b5b477da7"). InnerVolumeSpecName "kube-api-access-pz9xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:57:52.133818 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133797    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.133818 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133819    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz9xv\" (UniqueName: \"kubernetes.io/projected/2515828c-5182-47d4-aef8-021b5b477da7-kube-api-access-pz9xv\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.133943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133844    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.133943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133853    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.133943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133861    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2515828c-5182-47d4-aef8-021b5b477da7-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.133943 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.133868    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2515828c-5182-47d4-aef8-021b5b477da7-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:57:52.319507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.319488    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:52.319621 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.319526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:52.326709 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.326689    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:57:52.331421 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.331391    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/auth-test-model-1e65bd-kserve-7d7fcb9f-2czcx"]
Jul 15 22:57:52.332302 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:52.332286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:53.023515 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:53.023481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:57:53.355907 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:53.355816    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2515828c-5182-47d4-aef8-021b5b477da7" path="/var/lib/kubelet/pods/2515828c-5182-47d4-aef8-021b5b477da7/volumes"
Jul 15 22:57:56.304075 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:57:56.304043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:58:07.397133 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397413    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2515828c-5182-47d4-aef8-021b5b477da7" containerName="main"
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397423    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2515828c-5182-47d4-aef8-021b5b477da7" containerName="main"
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397439    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" containerName="main"
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397445    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" containerName="main"
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397499    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1e3c189-ddfd-4cf6-a312-40447d9eaff2" containerName="main"
Jul 15 22:58:07.397513 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.397507    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2515828c-5182-47d4-aef8-021b5b477da7" containerName="main"
Jul 15 22:58:07.400187 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.400170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.403196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.403167    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"default-dockercfg-slcv8\""
Jul 15 22:58:07.403196 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.403167    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"openshift-service-ca.crt\""
Jul 15 22:58:07.403381 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.403171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"sub-test-model-1e65bd-kserve-self-signed-certs\""
Jul 15 22:58:07.403381 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.403180    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"kube-root-ca.crt\""
Jul 15 22:58:07.413698 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.413674    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:58:07.517395 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.517368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:58:07.541308 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.541386 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.541425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.541459 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541432    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.541459 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx5vz\" (UniqueName: \"kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.541582 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.541466    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.641983 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.641960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.641983 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.641985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx5vz\" (UniqueName: \"kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642488 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642585 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.642585 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.642560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.644293 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.644274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.644485 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.644469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.650469 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.650416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx5vz\" (UniqueName: \"kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz\") pod \"sub-test-model-1e65bd-kserve-6d8964669c-pfd42\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") " pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.709946 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.709925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:07.844990 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:07.844964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:58:07.846645 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:58:07.846615    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod789c2adc_66bd_4c58_80cf_1eaa7b06f0cc.slice/crio-53c973a58deeca21d182409dd25bd87f4855caa99c93cad1cdc44145aed017a7 WatchSource:0}: Error finding container 53c973a58deeca21d182409dd25bd87f4855caa99c93cad1cdc44145aed017a7: Status 404 returned error can't find the container with id 53c973a58deeca21d182409dd25bd87f4855caa99c93cad1cdc44145aed017a7
Jul 15 22:58:08.081412 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:08.081377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" event={"ID":"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc","Type":"ContainerStarted","Data":"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"}
Jul 15 22:58:08.081560 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:08.081429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" event={"ID":"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc","Type":"ContainerStarted","Data":"53c973a58deeca21d182409dd25bd87f4855caa99c93cad1cdc44145aed017a7"}
Jul 15 22:58:08.170985 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:08.170960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:58:12.325535 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:12.325476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" podStartSLOduration=5.325460651 podStartE2EDuration="5.325460651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:58:08.112475559 +0000 UTC m=+2503.352393316" watchObservedRunningTime="2026-07-15 22:58:12.325460651 +0000 UTC m=+2507.565378461"
Jul 15 22:58:12.326396 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:12.326373    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:58:17.710419 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:17.710335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:17.710783 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:17.710421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:17.722376 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:17.722359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:18.145473 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:18.145447    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:58:24.036847 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:24.036811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:58:32.368328 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:32.368296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:58:51.299319 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:51.299284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:58:55.873792 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:55.873762    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:58:55.891221 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:55.891191    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:58:56.926485 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:56.926453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:58:56.938425 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:58:56.938383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:59:04.683820 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.683789    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 22:59:04.686674 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.686651    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.689060 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.689036    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d5b2a8\"/\"rate-test-model-d5b2a8-kserve-self-signed-certs\""
Jul 15 22:59:04.697516 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.697493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 22:59:04.717131 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.717100    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:59:04.813545 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmgx\" (UniqueName: \"kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.813656 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.813656 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.813735 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.813735 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.813799 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.813742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.914832 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.914926 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.914926 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmgx\" (UniqueName: \"kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.914926 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.915070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.915070 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.914966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.915276 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.915258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.915321 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.915306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.915366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.915335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.917242 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.917221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.917374 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.917356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.922596 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.922579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmgx\" (UniqueName: \"kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx\") pod \"rate-test-model-d5b2a8-kserve-d89597f55-l4zsh\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") " pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:04.996203 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:04.996145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:05.122798 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:05.122773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 22:59:05.125091 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:59:05.125060    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf063d1a_b523_465a_8042_0b1b320355ec.slice/crio-49423b5cf7da4a58b701fb03752b79b36ebeb07e4fe5f8c7769208b3526918a0 WatchSource:0}: Error finding container 49423b5cf7da4a58b701fb03752b79b36ebeb07e4fe5f8c7769208b3526918a0: Status 404 returned error can't find the container with id 49423b5cf7da4a58b701fb03752b79b36ebeb07e4fe5f8c7769208b3526918a0
Jul 15 22:59:05.360039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:05.359989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" event={"ID":"af063d1a-b523-465a-8042-0b1b320355ec","Type":"ContainerStarted","Data":"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"}
Jul 15 22:59:05.360214 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:05.360055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" event={"ID":"af063d1a-b523-465a-8042-0b1b320355ec","Type":"ContainerStarted","Data":"49423b5cf7da4a58b701fb03752b79b36ebeb07e4fe5f8c7769208b3526918a0"}
Jul 15 22:59:05.379486 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:05.379436    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" podStartSLOduration=1.379421387 podStartE2EDuration="1.379421387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:05.378616281 +0000 UTC m=+2560.618534039" watchObservedRunningTime="2026-07-15 22:59:05.379421387 +0000 UTC m=+2560.619339144"
Jul 15 22:59:08.689027 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:08.688982    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:59:10.893449 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:10.893410    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" podUID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" containerName="main" containerID="cri-o://88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080" gracePeriod=45
Jul 15 22:59:11.136208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.136185    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:59:11.167264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167241    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167437 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167437 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167437 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167336    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167437 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167391    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q57pz\" (UniqueName: \"kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz\") pod \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\" (UID: \"c72d3f27-c451-4acf-b0f4-5c559ab483a4\") "
Jul 15 22:59:11.167635 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167533    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache" (OuterVolumeSpecName: "model-cache") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:11.167635 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167587    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home" (OuterVolumeSpecName: "home") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:11.167727 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:11.167769 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167731    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.167769 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.167750    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.169339 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.169313    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:59:11.169436 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.169398    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm" (OuterVolumeSpecName: "dshm") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:11.169550 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.169511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz" (OuterVolumeSpecName: "kube-api-access-q57pz") pod "c72d3f27-c451-4acf-b0f4-5c559ab483a4" (UID: "c72d3f27-c451-4acf-b0f4-5c559ab483a4"). InnerVolumeSpecName "kube-api-access-q57pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:59:11.268130 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.268108    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.268130 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.268130    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.268264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.268140    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c72d3f27-c451-4acf-b0f4-5c559ab483a4-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.268264 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.268148    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q57pz\" (UniqueName: \"kubernetes.io/projected/c72d3f27-c451-4acf-b0f4-5c559ab483a4-kube-api-access-q57pz\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:11.388989 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.388958    2565 generic.go:356] "Generic (PLEG): container finished" podID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" containerID="88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080" exitCode=0
Jul 15 22:59:11.389121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.388997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" event={"ID":"c72d3f27-c451-4acf-b0f4-5c559ab483a4","Type":"ContainerDied","Data":"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"}
Jul 15 22:59:11.389121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.389007    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"
Jul 15 22:59:11.389121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.389053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7" event={"ID":"c72d3f27-c451-4acf-b0f4-5c559ab483a4","Type":"ContainerDied","Data":"0fb21f517091ad25186c2f89363c3e8567d9f6442bfca16ff8550588f4dd1738"}
Jul 15 22:59:11.389121 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.389071    2565 scope.go:117] "RemoveContainer" containerID="88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"
Jul 15 22:59:11.399465 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.399444    2565 scope.go:117] "RemoveContainer" containerID="88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"
Jul 15 22:59:11.399865 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:59:11.399839    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080\": container with ID starting with 88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080 not found: ID does not exist" containerID="88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"
Jul 15 22:59:11.399964 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.399875    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080"} err="failed to get container status \"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080\": rpc error: code = NotFound desc = could not find container \"88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080\": container with ID starting with 88ecbdd86dc78def1dcddbdcbc00f27bcab2a4d04edfcbae6b00026f9013f080 not found: ID does not exist"
Jul 15 22:59:11.420783 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.420731    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:59:11.426548 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.426528    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/sub-test-model-d5b2a8-kserve-c7d79f4cf-mltn7"]
Jul 15 22:59:11.946751 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:11.946707    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" podUID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" containerName="main" containerID="cri-o://5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648" gracePeriod=45
Jul 15 22:59:12.186058 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.186033    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:59:12.277460 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277430    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277516    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx5vz\" (UniqueName: \"kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277598 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277815 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home\") pod \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\" (UID: \"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc\") "
Jul 15 22:59:12.277815 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:12.277815 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277777    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache" (OuterVolumeSpecName: "model-cache") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:12.277966 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277920    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home" (OuterVolumeSpecName: "home") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:12.278039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277964    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.278039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.277985    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.278039 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.278005    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.279745 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.279710    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 22:59:12.279864 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.279755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm" (OuterVolumeSpecName: "dshm") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 22:59:12.279864 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.279795    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz" (OuterVolumeSpecName: "kube-api-access-fx5vz") pod "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" (UID: "789c2adc-66bd-4c58-80cf-1eaa7b06f0cc"). InnerVolumeSpecName "kube-api-access-fx5vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 22:59:12.379346 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.379310    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.379346 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.379338    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx5vz\" (UniqueName: \"kubernetes.io/projected/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-kube-api-access-fx5vz\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.379346 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.379348    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 22:59:12.394328 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.394296    2565 generic.go:356] "Generic (PLEG): container finished" podID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" containerID="5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648" exitCode=0
Jul 15 22:59:12.394509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.394342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"
Jul 15 22:59:12.394509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.394382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" event={"ID":"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc","Type":"ContainerDied","Data":"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"}
Jul 15 22:59:12.394509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.394424    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42" event={"ID":"789c2adc-66bd-4c58-80cf-1eaa7b06f0cc","Type":"ContainerDied","Data":"53c973a58deeca21d182409dd25bd87f4855caa99c93cad1cdc44145aed017a7"}
Jul 15 22:59:12.394509 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.394445    2565 scope.go:117] "RemoveContainer" containerID="5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"
Jul 15 22:59:12.403427 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.403409    2565 scope.go:117] "RemoveContainer" containerID="5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"
Jul 15 22:59:12.403640 ip-10-0-139-92 kubenswrapper[2565]: E0715 22:59:12.403622    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648\": container with ID starting with 5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648 not found: ID does not exist" containerID="5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"
Jul 15 22:59:12.403685 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.403645    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648"} err="failed to get container status \"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648\": rpc error: code = NotFound desc = could not find container \"5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648\": container with ID starting with 5a76b0d62603251181351d62c3fd7b9bf72b536c5211a1a0d8600c2e260cb648 not found: ID does not exist"
Jul 15 22:59:12.417945 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.417919    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:59:12.423442 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:12.423420    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/sub-test-model-1e65bd-kserve-6d8964669c-pfd42"]
Jul 15 22:59:13.362101 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:13.362061    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" path="/var/lib/kubelet/pods/789c2adc-66bd-4c58-80cf-1eaa7b06f0cc/volumes"
Jul 15 22:59:13.362612 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:13.362595    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" path="/var/lib/kubelet/pods/c72d3f27-c451-4acf-b0f4-5c559ab483a4/volumes"
Jul 15 22:59:14.996938 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:14.996904    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:14.997332 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:14.996955    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:15.009348 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:15.009325    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:15.419797 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:15.419769    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 22:59:21.196025 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.195989    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 22:59:21.196366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196321    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" containerName="main"
Jul 15 22:59:21.196366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196331    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" containerName="main"
Jul 15 22:59:21.196366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196344    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" containerName="main"
Jul 15 22:59:21.196366 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196351    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" containerName="main"
Jul 15 22:59:21.196507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196411    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c72d3f27-c451-4acf-b0f4-5c559ab483a4" containerName="main"
Jul 15 22:59:21.196507 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.196418    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="789c2adc-66bd-4c58-80cf-1eaa7b06f0cc" containerName="main"
Jul 15 22:59:21.200795 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.200774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.203405 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.203383    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"kube-root-ca.crt\""
Jul 15 22:59:21.204394 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.204372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"default-dockercfg-slcv8\""
Jul 15 22:59:21.204533 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.204398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"rate-test-model-1e65bd-kserve-self-signed-certs\""
Jul 15 22:59:21.204533 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.204397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e65bd\"/\"openshift-service-ca.crt\""
Jul 15 22:59:21.210209 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.210189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 22:59:21.245697 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.245793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.245793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.245793 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.245900 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqf8\" (UniqueName: \"kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.245900 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.245863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.292863 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.292834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:59:21.346718 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.346813 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.346813 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.346813 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.346813 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqf8\" (UniqueName: \"kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.346992 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.346825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.347208 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.347181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.347292 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.347224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.347292 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.347235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.349185 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.349160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.349284 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.349262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.356231 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.356208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqf8\" (UniqueName: \"kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8\") pod \"rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") " pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.510501 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.510443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:21.637682 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:21.637657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 22:59:21.640084 ip-10-0-139-92 kubenswrapper[2565]: W0715 22:59:21.640056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod571ab841_f1c7_4e26_89b8_f9d4a6f7cebd.slice/crio-01aeac93ce8f35a6cb94b9164cfe0309b0601fe0489ad9c9b6e35a0a32ede40c WatchSource:0}: Error finding container 01aeac93ce8f35a6cb94b9164cfe0309b0601fe0489ad9c9b6e35a0a32ede40c: Status 404 returned error can't find the container with id 01aeac93ce8f35a6cb94b9164cfe0309b0601fe0489ad9c9b6e35a0a32ede40c
Jul 15 22:59:22.443106 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:22.443069    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" event={"ID":"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd","Type":"ContainerStarted","Data":"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"}
Jul 15 22:59:22.443479 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:22.443116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" event={"ID":"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd","Type":"ContainerStarted","Data":"01aeac93ce8f35a6cb94b9164cfe0309b0601fe0489ad9c9b6e35a0a32ede40c"}
Jul 15 22:59:22.463351 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:22.463303    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" podStartSLOduration=1.463288177 podStartE2EDuration="1.463288177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:59:22.461804178 +0000 UTC m=+2577.701721937" watchObservedRunningTime="2026-07-15 22:59:22.463288177 +0000 UTC m=+2577.703205935"
Jul 15 22:59:27.096684 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:27.096653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 22:59:31.510657 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:31.510618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:31.511054 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:31.510668    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:31.522839 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:31.522814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:32.499957 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:32.499931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 22:59:39.235172 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:39.235134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:59:39.412739 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:39.412689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 22:59:41.701831 ip-10-0-139-92 kubenswrapper[2565]: I0715 22:59:41.701791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 23:00:00.548648 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:00.548612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 23:00:04.949563 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:04.949528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 23:00:04.983378 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:04.983345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:05.841345 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:05.841311    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 23:00:05.866871 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:05.866837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:10.561231 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.561199    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321562672"]
Jul 15 23:00:10.564777 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.564753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:10.568112 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.568088    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l7xt\""
Jul 15 23:00:10.574227 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.574201    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321562672"]
Jul 15 23:00:10.658865 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.658843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f2tm\" (UniqueName: \"kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm\") pod \"test-curl-7900-140265321562672\" (UID: \"ba79d23a-4649-4619-8c0a-cf65a9b55cc3\") " pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:10.759778 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.759754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f2tm\" (UniqueName: \"kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm\") pod \"test-curl-7900-140265321562672\" (UID: \"ba79d23a-4649-4619-8c0a-cf65a9b55cc3\") " pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:10.775581 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.775555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f2tm\" (UniqueName: \"kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm\") pod \"test-curl-7900-140265321562672\" (UID: \"ba79d23a-4649-4619-8c0a-cf65a9b55cc3\") " pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:10.874393 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:10.874327    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:11.010651 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:11.010611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321562672"]
Jul 15 23:00:11.010972 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:11.010949    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba79d23a_4649_4619_8c0a_cf65a9b55cc3.slice/crio-6a6de32c78b1c1b933bdffcec9a411f7bed7801f5ab5f6b36fc39335fbf275c3 WatchSource:0}: Error finding container 6a6de32c78b1c1b933bdffcec9a411f7bed7801f5ab5f6b36fc39335fbf275c3: Status 404 returned error can't find the container with id 6a6de32c78b1c1b933bdffcec9a411f7bed7801f5ab5f6b36fc39335fbf275c3
Jul 15 23:00:11.012430 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:11.012406    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 23:00:11.672612 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:11.672566    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321562672" event={"ID":"ba79d23a-4649-4619-8c0a-cf65a9b55cc3","Type":"ContainerStarted","Data":"6a6de32c78b1c1b933bdffcec9a411f7bed7801f5ab5f6b36fc39335fbf275c3"}
Jul 15 23:00:12.679030 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:12.678986    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" containerID="b5d614e9683028e89fc337a4fb7bed1653f809ff4939a821af133d5359f95f81" exitCode=0
Jul 15 23:00:12.679392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:12.679075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321562672" event={"ID":"ba79d23a-4649-4619-8c0a-cf65a9b55cc3","Type":"ContainerDied","Data":"b5d614e9683028e89fc337a4fb7bed1653f809ff4939a821af133d5359f95f81"}
Jul 15 23:00:13.813198 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.813173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:13.835229 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.835209    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321562672_ba79d23a-4649-4619-8c0a-cf65a9b55cc3/test-curl-7900-140265321562672/0.log"
Jul 15 23:00:13.863240 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.863210    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321562672"]
Jul 15 23:00:13.868992 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.868970    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321562672"]
Jul 15 23:00:13.886254 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.886228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f2tm\" (UniqueName: \"kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm\") pod \"ba79d23a-4649-4619-8c0a-cf65a9b55cc3\" (UID: \"ba79d23a-4649-4619-8c0a-cf65a9b55cc3\") "
Jul 15 23:00:13.888356 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.888328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm" (OuterVolumeSpecName: "kube-api-access-7f2tm") pod "ba79d23a-4649-4619-8c0a-cf65a9b55cc3" (UID: "ba79d23a-4649-4619-8c0a-cf65a9b55cc3"). InnerVolumeSpecName "kube-api-access-7f2tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:13.987754 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:13.987678    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f2tm\" (UniqueName: \"kubernetes.io/projected/ba79d23a-4649-4619-8c0a-cf65a9b55cc3-kube-api-access-7f2tm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:14.059475 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.059444    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:14.059807 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.059793    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" containerName="test-curl-7900-140265321562672"
Jul 15 23:00:14.059851 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.059809    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" containerName="test-curl-7900-140265321562672"
Jul 15 23:00:14.059886 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.059858    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" containerName="test-curl-7900-140265321562672"
Jul 15 23:00:14.062830 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.062815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:14.068288 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.068262    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:14.189092 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.189051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrxd\" (UniqueName: \"kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd\") pod \"test-curl-7900-140265321635888\" (UID: \"b0393c79-4e08-4bd6-a3f9-65cae0c97979\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:14.290294 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.290261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrxd\" (UniqueName: \"kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd\") pod \"test-curl-7900-140265321635888\" (UID: \"b0393c79-4e08-4bd6-a3f9-65cae0c97979\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:14.299192 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.299168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrxd\" (UniqueName: \"kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd\") pod \"test-curl-7900-140265321635888\" (UID: \"b0393c79-4e08-4bd6-a3f9-65cae0c97979\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:14.373678 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.373647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:14.500839 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.500814    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:14.502434 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:14.502414    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0393c79_4e08_4bd6_a3f9_65cae0c97979.slice/crio-74cfd6f42981f0e507e44016dffea6728b304d3a6219ee5a2281a5342c3d2e2e WatchSource:0}: Error finding container 74cfd6f42981f0e507e44016dffea6728b304d3a6219ee5a2281a5342c3d2e2e: Status 404 returned error can't find the container with id 74cfd6f42981f0e507e44016dffea6728b304d3a6219ee5a2281a5342c3d2e2e
Jul 15 23:00:14.688860 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.688828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321635888" event={"ID":"b0393c79-4e08-4bd6-a3f9-65cae0c97979","Type":"ContainerStarted","Data":"74cfd6f42981f0e507e44016dffea6728b304d3a6219ee5a2281a5342c3d2e2e"}
Jul 15 23:00:14.689956 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.689940    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a6de32c78b1c1b933bdffcec9a411f7bed7801f5ab5f6b36fc39335fbf275c3"
Jul 15 23:00:14.690062 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:14.689949    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:14.700280 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:14.700252    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321562672\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:15.095617 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:15.095584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:15.222773 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:15.222695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:15.356272 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:15.356239    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321562672\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" pod="opendatahub/test-curl-7900-140265321562672"
Jul 15 23:00:15.356442 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:15.356403    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba79d23a-4649-4619-8c0a-cf65a9b55cc3" path="/var/lib/kubelet/pods/ba79d23a-4649-4619-8c0a-cf65a9b55cc3/volumes"
Jul 15 23:00:15.695611 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:15.695575    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0393c79-4e08-4bd6-a3f9-65cae0c97979" containerID="1c291d42d1c76cfe611ec6e58c5ef2a24b84ce7f550a72f84a5a4cd373491955" exitCode=0
Jul 15 23:00:15.695775 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:15.695625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321635888" event={"ID":"b0393c79-4e08-4bd6-a3f9-65cae0c97979","Type":"ContainerDied","Data":"1c291d42d1c76cfe611ec6e58c5ef2a24b84ce7f550a72f84a5a4cd373491955"}
Jul 15 23:00:16.831769 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.831744    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:16.872915 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.872890    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321635888_b0393c79-4e08-4bd6-a3f9-65cae0c97979/test-curl-7900-140265321635888/0.log"
Jul 15 23:00:16.904612 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.904587    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:16.909124 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.909101    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:16.913418 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.913401    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vrxd\" (UniqueName: \"kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd\") pod \"b0393c79-4e08-4bd6-a3f9-65cae0c97979\" (UID: \"b0393c79-4e08-4bd6-a3f9-65cae0c97979\") "
Jul 15 23:00:16.915400 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.915370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd" (OuterVolumeSpecName: "kube-api-access-7vrxd") pod "b0393c79-4e08-4bd6-a3f9-65cae0c97979" (UID: "b0393c79-4e08-4bd6-a3f9-65cae0c97979"). InnerVolumeSpecName "kube-api-access-7vrxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:16.922914 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:16.922893    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 23:00:17.014803 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.014785    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vrxd\" (UniqueName: \"kubernetes.io/projected/b0393c79-4e08-4bd6-a3f9-65cae0c97979-kube-api-access-7vrxd\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:17.030940 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.030914    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:17.031238 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.031225    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0393c79-4e08-4bd6-a3f9-65cae0c97979" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:17.031292 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.031240    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0393c79-4e08-4bd6-a3f9-65cae0c97979" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:17.031338 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.031313    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0393c79-4e08-4bd6-a3f9-65cae0c97979" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:17.034254 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.034237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:17.042216 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.042194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:17.116162 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.116122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzjsx\" (UniqueName: \"kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx\") pod \"test-curl-7900-140265321635888\" (UID: \"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:17.217256 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.217224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzjsx\" (UniqueName: \"kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx\") pod \"test-curl-7900-140265321635888\" (UID: \"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:17.228076 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.228048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzjsx\" (UniqueName: \"kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx\") pod \"test-curl-7900-140265321635888\" (UID: \"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71\") " pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:17.343885 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.343816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:17.356776 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.356753    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0393c79-4e08-4bd6-a3f9-65cae0c97979" path="/var/lib/kubelet/pods/b0393c79-4e08-4bd6-a3f9-65cae0c97979/volumes"
Jul 15 23:00:17.487180 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.487148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:17.488788 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:17.488762    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76e54681_88a4_4bdc_80ca_f5e3e5a7ca71.slice/crio-0bf983309a4e2573ebb76ca922fd21232e0442012bec7dbe5c9068a502fcbb4f WatchSource:0}: Error finding container 0bf983309a4e2573ebb76ca922fd21232e0442012bec7dbe5c9068a502fcbb4f: Status 404 returned error can't find the container with id 0bf983309a4e2573ebb76ca922fd21232e0442012bec7dbe5c9068a502fcbb4f
Jul 15 23:00:17.705996 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.705916    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321635888" event={"ID":"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71","Type":"ContainerStarted","Data":"0bf983309a4e2573ebb76ca922fd21232e0442012bec7dbe5c9068a502fcbb4f"}
Jul 15 23:00:17.707174 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.707153    2565 scope.go:117] "RemoveContainer" containerID="1c291d42d1c76cfe611ec6e58c5ef2a24b84ce7f550a72f84a5a4cd373491955"
Jul 15 23:00:17.707174 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:17.707173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:18.719956 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:18.719914    2565 generic.go:356] "Generic (PLEG): container finished" podID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" containerID="28ac558d23f43a2eb8d4842cac853fb9ec187220d083621b67d2c8a854859226" exitCode=0
Jul 15 23:00:18.720340 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:18.719994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321635888" event={"ID":"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71","Type":"ContainerDied","Data":"28ac558d23f43a2eb8d4842cac853fb9ec187220d083621b67d2c8a854859226"}
Jul 15 23:00:19.856593 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.856568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:19.879847 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.879813    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321635888_76e54681-88a4-4bdc-80ca-f5e3e5a7ca71/test-curl-7900-140265321635888/0.log"
Jul 15 23:00:19.903966 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.903941    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:19.906953 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.906933    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321635888"]
Jul 15 23:00:19.938813 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.938791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzjsx\" (UniqueName: \"kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx\") pod \"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71\" (UID: \"76e54681-88a4-4bdc-80ca-f5e3e5a7ca71\") "
Jul 15 23:00:19.940735 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.940714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx" (OuterVolumeSpecName: "kube-api-access-jzjsx") pod "76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" (UID: "76e54681-88a4-4bdc-80ca-f5e3e5a7ca71"). InnerVolumeSpecName "kube-api-access-jzjsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:19.968798 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:19.968768    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" podUID="af063d1a-b523-465a-8042-0b1b320355ec" containerName="main" containerID="cri-o://89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc" gracePeriod=45
Jul 15 23:00:20.039711 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.039683    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzjsx\" (UniqueName: \"kubernetes.io/projected/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71-kube-api-access-jzjsx\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.216205 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.216181    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 23:00:20.342670 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.342842 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.342842 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.342842 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.343006 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342848    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsmgx\" (UniqueName: \"kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.343006 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs\") pod \"af063d1a-b523-465a-8042-0b1b320355ec\" (UID: \"af063d1a-b523-465a-8042-0b1b320355ec\") "
Jul 15 23:00:20.343006 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:20.343006 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.342961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:20.343208 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.343036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home" (OuterVolumeSpecName: "home") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:20.343208 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.343172    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.343208 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.343192    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.343208 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.343206    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.344906 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.344872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm" (OuterVolumeSpecName: "dshm") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:20.345038 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.344937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:00:20.345038 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.344956    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx" (OuterVolumeSpecName: "kube-api-access-hsmgx") pod "af063d1a-b523-465a-8042-0b1b320355ec" (UID: "af063d1a-b523-465a-8042-0b1b320355ec"). InnerVolumeSpecName "kube-api-access-hsmgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:20.443515 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.443492    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsmgx\" (UniqueName: \"kubernetes.io/projected/af063d1a-b523-465a-8042-0b1b320355ec-kube-api-access-hsmgx\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.443515 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.443514    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af063d1a-b523-465a-8042-0b1b320355ec-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.443679 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.443529    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af063d1a-b523-465a-8042-0b1b320355ec-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:20.732383 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.732295    2565 generic.go:356] "Generic (PLEG): container finished" podID="af063d1a-b523-465a-8042-0b1b320355ec" containerID="89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc" exitCode=0
Jul 15 23:00:20.732383 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.732344    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"
Jul 15 23:00:20.732617 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.732383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" event={"ID":"af063d1a-b523-465a-8042-0b1b320355ec","Type":"ContainerDied","Data":"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"}
Jul 15 23:00:20.732617 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.732435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh" event={"ID":"af063d1a-b523-465a-8042-0b1b320355ec","Type":"ContainerDied","Data":"49423b5cf7da4a58b701fb03752b79b36ebeb07e4fe5f8c7769208b3526918a0"}
Jul 15 23:00:20.732617 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.732460    2565 scope.go:117] "RemoveContainer" containerID="89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"
Jul 15 23:00:20.733772 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.733735    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bf983309a4e2573ebb76ca922fd21232e0442012bec7dbe5c9068a502fcbb4f"
Jul 15 23:00:20.733772 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.733740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:20.740724 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.740706    2565 scope.go:117] "RemoveContainer" containerID="89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"
Jul 15 23:00:20.740994 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:20.740977    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc\": container with ID starting with 89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc not found: ID does not exist" containerID="89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"
Jul 15 23:00:20.741070 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.741001    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc"} err="failed to get container status \"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc\": rpc error: code = NotFound desc = could not find container \"89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc\": container with ID starting with 89245aa14a6e1c0ebd81818f1fdc249aa0b3189759433ff787508f6256ece9cc not found: ID does not exist"
Jul 15 23:00:20.757374 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.757353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 23:00:20.761540 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:20.761514    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321635888\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:20.761879 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.761862    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d5b2a8/rate-test-model-d5b2a8-kserve-d89597f55-l4zsh"]
Jul 15 23:00:20.763361 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:20.763337    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321635888\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:20.862844 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:20.862810    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" podUID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" containerName="main" containerID="cri-o://148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d" gracePeriod=45
Jul 15 23:00:21.113162 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.113137    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 23:00:21.115317 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:21.115293    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321635888\" is forbidden: User \"system:node:ip-10-0-139-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-92.ec2.internal' and this object" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" pod="opendatahub/test-curl-7900-140265321635888"
Jul 15 23:00:21.249963 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.249937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250114 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.249983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250114 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250004    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250114 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250037    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xqf8\" (UniqueName: \"kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250114 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250336 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250124    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs\") pod \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\" (UID: \"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd\") "
Jul 15 23:00:21.250336 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:21.250336 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250271    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache" (OuterVolumeSpecName: "model-cache") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:21.250336 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250319    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home" (OuterVolumeSpecName: "home") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:21.250510 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250370    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-model-cache\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.250510 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250384    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-home\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.250510 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.250397    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tmp-dir\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.252107 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.252072    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm" (OuterVolumeSpecName: "dshm") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 23:00:21.252172 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.252152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 23:00:21.252232 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.252212    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8" (OuterVolumeSpecName: "kube-api-access-8xqf8") pod "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" (UID: "571ab841-f1c7-4e26-89b8-f9d4a6f7cebd"). InnerVolumeSpecName "kube-api-access-8xqf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:21.350852 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.350796    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-dshm\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.350852 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.350815    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xqf8\" (UniqueName: \"kubernetes.io/projected/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-kube-api-access-8xqf8\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.350852 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.350827    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd-tls-certs\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:21.357083 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.357060    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" path="/var/lib/kubelet/pods/76e54681-88a4-4bdc-80ca-f5e3e5a7ca71/volumes"
Jul 15 23:00:21.357469 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.357455    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af063d1a-b523-465a-8042-0b1b320355ec" path="/var/lib/kubelet/pods/af063d1a-b523-465a-8042-0b1b320355ec/volumes"
Jul 15 23:00:21.740314 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.740241    2565 generic.go:356] "Generic (PLEG): container finished" podID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" containerID="148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d" exitCode=0
Jul 15 23:00:21.740314 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.740290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"
Jul 15 23:00:21.740536 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.740331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" event={"ID":"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd","Type":"ContainerDied","Data":"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"}
Jul 15 23:00:21.740536 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.740371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc" event={"ID":"571ab841-f1c7-4e26-89b8-f9d4a6f7cebd","Type":"ContainerDied","Data":"01aeac93ce8f35a6cb94b9164cfe0309b0601fe0489ad9c9b6e35a0a32ede40c"}
Jul 15 23:00:21.740536 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.740394    2565 scope.go:117] "RemoveContainer" containerID="148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"
Jul 15 23:00:21.748849 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.748832    2565 scope.go:117] "RemoveContainer" containerID="148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"
Jul 15 23:00:21.749135 ip-10-0-139-92 kubenswrapper[2565]: E0715 23:00:21.749111    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d\": container with ID starting with 148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d not found: ID does not exist" containerID="148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"
Jul 15 23:00:21.749236 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.749139    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d"} err="failed to get container status \"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d\": rpc error: code = NotFound desc = could not find container \"148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d\": container with ID starting with 148daa62a0e7e9a3c0d3ca2892dd2c65725fd51e61f1ca1e0d4ab6ea9a9a4f4d not found: ID does not exist"
Jul 15 23:00:21.758289 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.758267    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 23:00:21.761903 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:21.761884    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e65bd/rate-test-model-1e65bd-kserve-7f96ddd46c-mczsc"]
Jul 15 23:00:22.603045 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603001    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321636896"]
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603312    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603324    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603333    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af063d1a-b523-465a-8042-0b1b320355ec" containerName="main"
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603338    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af063d1a-b523-465a-8042-0b1b320355ec" containerName="main"
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603344    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" containerName="main"
Jul 15 23:00:22.603392 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603349    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" containerName="main"
Jul 15 23:00:22.603583 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603428    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af063d1a-b523-465a-8042-0b1b320355ec" containerName="main"
Jul 15 23:00:22.603583 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603438    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" containerName="main"
Jul 15 23:00:22.603583 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.603445    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="76e54681-88a4-4bdc-80ca-f5e3e5a7ca71" containerName="test-curl-7900-140265321635888"
Jul 15 23:00:22.607563 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.607547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:22.610195 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.610176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l7xt\""
Jul 15 23:00:22.614773 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.614739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"]
Jul 15 23:00:22.660166 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.660132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv\") pod \"test-curl-7900-140265321636896\" (UID: \"8a051dc8-5b95-4654-8fe1-baa4f62f7240\") " pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:22.760740 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.760714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv\") pod \"test-curl-7900-140265321636896\" (UID: \"8a051dc8-5b95-4654-8fe1-baa4f62f7240\") " pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:22.770659 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.770635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv\") pod \"test-curl-7900-140265321636896\" (UID: \"8a051dc8-5b95-4654-8fe1-baa4f62f7240\") " pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:22.917425 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:22.917367    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:23.042112 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.042083    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"]
Jul 15 23:00:23.044067 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:23.044037    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a051dc8_5b95_4654_8fe1_baa4f62f7240.slice/crio-715b8f3da0fcff8f71db14e1224de34c6871d59f0cc73161c5d6a1722213366f WatchSource:0}: Error finding container 715b8f3da0fcff8f71db14e1224de34c6871d59f0cc73161c5d6a1722213366f: Status 404 returned error can't find the container with id 715b8f3da0fcff8f71db14e1224de34c6871d59f0cc73161c5d6a1722213366f
Jul 15 23:00:23.181615 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.181545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:23.285899 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.285875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:23.356835 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.356811    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571ab841-f1c7-4e26-89b8-f9d4a6f7cebd" path="/var/lib/kubelet/pods/571ab841-f1c7-4e26-89b8-f9d4a6f7cebd/volumes"
Jul 15 23:00:23.752614 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.752532    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a051dc8-5b95-4654-8fe1-baa4f62f7240" containerID="ac23643d6b0608b9a7abe0bc7f9e55753d54457f08a5a4a3ab7ec3d82ac8a374" exitCode=0
Jul 15 23:00:23.752614 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.752577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321636896" event={"ID":"8a051dc8-5b95-4654-8fe1-baa4f62f7240","Type":"ContainerDied","Data":"ac23643d6b0608b9a7abe0bc7f9e55753d54457f08a5a4a3ab7ec3d82ac8a374"}
Jul 15 23:00:23.752614 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:23.752603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321636896" event={"ID":"8a051dc8-5b95-4654-8fe1-baa4f62f7240","Type":"ContainerStarted","Data":"715b8f3da0fcff8f71db14e1224de34c6871d59f0cc73161c5d6a1722213366f"}
Jul 15 23:00:24.884447 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.884421    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:24.923284 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.923257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321636896_8a051dc8-5b95-4654-8fe1-baa4f62f7240/test-curl-7900-140265321636896/0.log"
Jul 15 23:00:24.952477 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.952453    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"]
Jul 15 23:00:24.958671 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.958647    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"]
Jul 15 23:00:24.977214 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.977193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv\") pod \"8a051dc8-5b95-4654-8fe1-baa4f62f7240\" (UID: \"8a051dc8-5b95-4654-8fe1-baa4f62f7240\") "
Jul 15 23:00:24.979141 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:24.979114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv" (OuterVolumeSpecName: "kube-api-access-fv7rv") pod "8a051dc8-5b95-4654-8fe1-baa4f62f7240" (UID: "8a051dc8-5b95-4654-8fe1-baa4f62f7240"). InnerVolumeSpecName "kube-api-access-fv7rv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 23:00:25.078409 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.078385    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7rv\" (UniqueName: \"kubernetes.io/projected/8a051dc8-5b95-4654-8fe1-baa4f62f7240-kube-api-access-fv7rv\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:25.138259 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.138232    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"]
Jul 15 23:00:25.138564 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.138550    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a051dc8-5b95-4654-8fe1-baa4f62f7240" containerName="test-curl-7900-140265321636896"
Jul 15 23:00:25.138612 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.138566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a051dc8-5b95-4654-8fe1-baa4f62f7240" containerName="test-curl-7900-140265321636896"
Jul 15 23:00:25.138652 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.138627    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a051dc8-5b95-4654-8fe1-baa4f62f7240" containerName="test-curl-7900-140265321636896"
Jul 15 23:00:25.141465 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.141449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:25.144158 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.144138    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 23:00:25.144258 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.144144    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 23:00:25.151444 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.151425    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"]
Jul 15 23:00:25.279463 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.279437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6\" (UID: \"3fe934e6-6390-42f2-9bea-47c09cbee429\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:25.358065 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.357994    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a051dc8-5b95-4654-8fe1-baa4f62f7240" path="/var/lib/kubelet/pods/8a051dc8-5b95-4654-8fe1-baa4f62f7240/volumes"
Jul 15 23:00:25.380721 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.380697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6\" (UID: \"3fe934e6-6390-42f2-9bea-47c09cbee429\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:25.383603 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.383585    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 23:00:25.391794 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.391772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6\" (UID: \"3fe934e6-6390-42f2-9bea-47c09cbee429\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:25.457513 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.457496    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 23:00:25.462564 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.462542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:25.626588 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.626543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"]
Jul 15 23:00:25.628740 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:25.628714    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe934e6_6390_42f2_9bea_47c09cbee429.slice/crio-34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9 WatchSource:0}: Error finding container 34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9: Status 404 returned error can't find the container with id 34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9
Jul 15 23:00:25.763719 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.763695    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896"
Jul 15 23:00:25.763874 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.763726    2565 scope.go:117] "RemoveContainer" containerID="ac23643d6b0608b9a7abe0bc7f9e55753d54457f08a5a4a3ab7ec3d82ac8a374"
Jul 15 23:00:25.764995 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.764973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6" event={"ID":"3fe934e6-6390-42f2-9bea-47c09cbee429","Type":"ContainerStarted","Data":"34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9"}
Jul 15 23:00:25.978205 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:25.978140    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:26.097651 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:26.097615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:26.772020 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:26.771985    2565 generic.go:356] "Generic (PLEG): container finished" podID="3fe934e6-6390-42f2-9bea-47c09cbee429" containerID="2ec9a841ce4b31ed600b4f28a32392e52207f87d787df57b88ebc970581e4cf5" exitCode=0
Jul 15 23:00:26.772198 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:26.772071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6" event={"ID":"3fe934e6-6390-42f2-9bea-47c09cbee429","Type":"ContainerDied","Data":"2ec9a841ce4b31ed600b4f28a32392e52207f87d787df57b88ebc970581e4cf5"}
Jul 15 23:00:27.905457 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:27.905433    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:28.001224 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.001199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca\") pod \"3fe934e6-6390-42f2-9bea-47c09cbee429\" (UID: \"3fe934e6-6390-42f2-9bea-47c09cbee429\") "
Jul 15 23:00:28.001492 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.001469    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3fe934e6-6390-42f2-9bea-47c09cbee429" (UID: "3fe934e6-6390-42f2-9bea-47c09cbee429"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:00:28.102118 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.102064    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fe934e6-6390-42f2-9bea-47c09cbee429-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:28.781654 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.781627    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6"
Jul 15 23:00:28.781822 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.781676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6" event={"ID":"3fe934e6-6390-42f2-9bea-47c09cbee429","Type":"ContainerDied","Data":"34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9"}
Jul 15 23:00:28.781822 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:28.781718    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34714371b0d52c7d0594402afd96871fd7b5612db666d380de71780547ff43b9"
Jul 15 23:00:35.818499 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:35.818458    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:39.325197 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:39.325164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 23:00:40.259522 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:40.259493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:44.214111 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:44.214072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:46.105102 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:46.105072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:46.164956 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:46.164928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:50.932709 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:50.932674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:51.162483 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.162448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:51.291480 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.288993    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"]
Jul 15 23:00:51.291480 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.289741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fe934e6-6390-42f2-9bea-47c09cbee429" containerName="revoke-keys"
Jul 15 23:00:51.291480 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.289763    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fe934e6-6390-42f2-9bea-47c09cbee429" containerName="revoke-keys"
Jul 15 23:00:51.291480 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.289915    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fe934e6-6390-42f2-9bea-47c09cbee429" containerName="revoke-keys"
Jul 15 23:00:51.295733 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.295684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:51.298411 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.298378    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"]
Jul 15 23:00:51.298546 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.298448    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\""
Jul 15 23:00:51.298546 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.298450    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 23:00:51.380909 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.380875    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj\" (UID: \"af200baa-630e-4e9a-b354-e359efc55585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:51.482001 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.481950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj\" (UID: \"af200baa-630e-4e9a-b354-e359efc55585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:51.482600 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.482581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj\" (UID: \"af200baa-630e-4e9a-b354-e359efc55585\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:51.607337 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.607257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:51.764224 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.764193    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"]
Jul 15 23:00:51.766860 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:00:51.766832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf200baa_630e_4e9a_b354_e359efc55585.slice/crio-40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f WatchSource:0}: Error finding container 40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f: Status 404 returned error can't find the container with id 40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f
Jul 15 23:00:51.885625 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.885552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:51.895025 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.894987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj" event={"ID":"af200baa-630e-4e9a-b354-e359efc55585","Type":"ContainerStarted","Data":"40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f"}
Jul 15 23:00:51.974336 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:51.974310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:00:52.902001 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:52.901965    2565 generic.go:356] "Generic (PLEG): container finished" podID="af200baa-630e-4e9a-b354-e359efc55585" containerID="5fc07380f21ff5086157e96e02797fc6d5719e2a22d1a16d72e28dd0a5d3247e" exitCode=0
Jul 15 23:00:52.902202 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:52.902050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj" event={"ID":"af200baa-630e-4e9a-b354-e359efc55585","Type":"ContainerDied","Data":"5fc07380f21ff5086157e96e02797fc6d5719e2a22d1a16d72e28dd0a5d3247e"}
Jul 15 23:00:54.033692 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.033666    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:54.206645 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.206553    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca\") pod \"af200baa-630e-4e9a-b354-e359efc55585\" (UID: \"af200baa-630e-4e9a-b354-e359efc55585\") "
Jul 15 23:00:54.206925 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.206901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af200baa-630e-4e9a-b354-e359efc55585" (UID: "af200baa-630e-4e9a-b354-e359efc55585"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 23:00:54.307670 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.307639    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af200baa-630e-4e9a-b354-e359efc55585-maas-api-service-ca\") on node \"ip-10-0-139-92.ec2.internal\" DevicePath \"\""
Jul 15 23:00:54.912594 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.912559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj" event={"ID":"af200baa-630e-4e9a-b354-e359efc55585","Type":"ContainerDied","Data":"40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f"}
Jul 15 23:00:54.912594 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.912592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj"
Jul 15 23:00:54.912800 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:00:54.912608    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40ec65ad8d6c30e4a3f421fc7dc41fceaab47e6a0332d2bb1a0fe22ea9f2614f"
Jul 15 23:01:01.795752 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:01.795712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:04.900711 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:04.900677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g7fkx"]
Jul 15 23:01:06.379634 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:06.379589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:13.165674 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:13.165634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:13.247871 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:13.247836    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:17.144420 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:17.144342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:17.333556 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:17.333514    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:17.740522 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:17.740474    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5bd55dfb-8tgdd_8d089c58-66a1-4d90-9330-1e1c19a8254e/authorino/0.log"
Jul 15 23:01:23.908454 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:23.908422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hfj4r_68a61635-fe78-4c57-a97c-b43237fc51ee/manager/0.log"
Jul 15 23:01:24.201827 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:24.201751    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-qcnfb_1e205520-a4e6-4a5e-a91b-272e481d8ed8/manager/0.log"
Jul 15 23:01:24.225380 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:24.225352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-qcnfb_1e205520-a4e6-4a5e-a91b-272e481d8ed8/copy-manifests/0.log"
Jul 15 23:01:24.970431 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:24.970403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735925-c757r_046c3da2-318f-48c7-a934-e800331e5645/cleanup/0.log"
Jul 15 23:01:25.197485 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.197455    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-7ab2faa6-8qhmb_87d6b9e6-167a-45ab-af9d-9531937002d8/revoke-keys/0.log"
Jul 15 23:01:25.409875 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.409844    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 23:01:25.415260 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.415241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cw62k_17d3892b-ef76-4653-b740-976c3ef55158/ovn-acl-logging/0.log"
Jul 15 23:01:25.427852 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.427833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-d5616e-jj4rl_2b10a525-4aa4-4992-9c1b-a7456ede46de/revoke-keys/0.log"
Jul 15 23:01:25.545709 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.545685    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-72a6d5-6tt8k_c7fcb0cc-9cad-4f00-93af-3d5fb0d3c2f0/revoke-keys/0.log"
Jul 15 23:01:25.660457 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.660384    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-bf7f9845-r78zk_697fe0ce-9f2c-418c-8962-bc7e707606cf/revoke-keys/0.log"
Jul 15 23:01:25.884746 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.884718    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-7fdd49-4fckz_5634509b-ce9f-49c3-ae07-2981f730819e/revoke-keys/0.log"
Jul 15 23:01:25.999783 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:25.999706    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-abe03dff-vj8n4_69ee6aa2-7134-4a81-9567-f0a8619298ed/revoke-keys/0.log"
Jul 15 23:01:26.114149 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:26.114119    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-12a4c319-zgzm9_c8b0ec3f-aace-4303-b4fc-ee570f51421d/revoke-keys/0.log"
Jul 15 23:01:26.230455 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:26.230427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-79ecefd7-k4kbl_602becfd-f631-4719-b4a4-0dc0ff501efc/revoke-keys/0.log"
Jul 15 23:01:26.351002 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:26.350963    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-d5b2a8-pd4k6_3fe934e6-6390-42f2-9bea-47c09cbee429/revoke-keys/0.log"
Jul 15 23:01:26.468213 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:26.468179    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-1e65bd-4vkzj_af200baa-630e-4e9a-b354-e359efc55585/revoke-keys/0.log"
Jul 15 23:01:27.889702 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:27.889670    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5bd55dfb-8tgdd_8d089c58-66a1-4d90-9330-1e1c19a8254e/authorino/0.log"
Jul 15 23:01:28.239104 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:28.239007    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vrjx2_2b9ebc8c-0948-4179-88c6-19343e7eb682/kuadrant-console-plugin/0.log"
Jul 15 23:01:28.605628 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:28.605599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g7fkx_2b1addb6-8182-4556-8367-ebc15688ce93/limitador/0.log"
Jul 15 23:01:29.435978 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:29.435944    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-pkh4g_22eb5a35-4db9-41e4-8397-6f3927e69174/kube-auth-proxy/0.log"
Jul 15 23:01:30.508815 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:30.508781    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7pqns_1408706a-a109-406d-8cd8-7498b89e86e9/main/0.log"
Jul 15 23:01:30.843504 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:30.843474    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-g66pt_8f621251-804a-4945-8c59-85459278db85/main/0.log"
Jul 15 23:01:36.341053 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.341008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxsw4/must-gather-nqtqc"]
Jul 15 23:01:36.341447 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.341324    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af200baa-630e-4e9a-b354-e359efc55585" containerName="revoke-keys"
Jul 15 23:01:36.341447 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.341335    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af200baa-630e-4e9a-b354-e359efc55585" containerName="revoke-keys"
Jul 15 23:01:36.341447 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.341401    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af200baa-630e-4e9a-b354-e359efc55585" containerName="revoke-keys"
Jul 15 23:01:36.344842 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.344825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.348497 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.348478    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"kube-root-ca.crt\""
Jul 15 23:01:36.349355 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.349336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"openshift-service-ca.crt\""
Jul 15 23:01:36.349456 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.349341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rxsw4\"/\"default-dockercfg-7dk94\""
Jul 15 23:01:36.358639 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.358620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/must-gather-nqtqc"]
Jul 15 23:01:36.387813 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.387784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:36.458167 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.458134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s64tp\" (UniqueName: \"kubernetes.io/projected/27b74bf4-a05a-4ee0-9066-43ea065c15db-kube-api-access-s64tp\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.458298 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.458216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27b74bf4-a05a-4ee0-9066-43ea065c15db-must-gather-output\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.559086 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.559056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27b74bf4-a05a-4ee0-9066-43ea065c15db-must-gather-output\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.559221 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.559108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s64tp\" (UniqueName: \"kubernetes.io/projected/27b74bf4-a05a-4ee0-9066-43ea065c15db-kube-api-access-s64tp\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.559404 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.559385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/27b74bf4-a05a-4ee0-9066-43ea065c15db-must-gather-output\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.567173 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.567145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s64tp\" (UniqueName: \"kubernetes.io/projected/27b74bf4-a05a-4ee0-9066-43ea065c15db-kube-api-access-s64tp\") pod \"must-gather-nqtqc\" (UID: \"27b74bf4-a05a-4ee0-9066-43ea065c15db\") " pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.654316 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.654250    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/must-gather-nqtqc"
Jul 15 23:01:36.784092 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:36.784067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/must-gather-nqtqc"]
Jul 15 23:01:36.786199 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:01:36.786172    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27b74bf4_a05a_4ee0_9066_43ea065c15db.slice/crio-3078a56b2eaf2284ebea95342ead9e949de1f6874bb05c8c569d309f23638065 WatchSource:0}: Error finding container 3078a56b2eaf2284ebea95342ead9e949de1f6874bb05c8c569d309f23638065: Status 404 returned error can't find the container with id 3078a56b2eaf2284ebea95342ead9e949de1f6874bb05c8c569d309f23638065
Jul 15 23:01:37.109912 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:37.109871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/must-gather-nqtqc" event={"ID":"27b74bf4-a05a-4ee0-9066-43ea065c15db","Type":"ContainerStarted","Data":"3078a56b2eaf2284ebea95342ead9e949de1f6874bb05c8c569d309f23638065"}
Jul 15 23:01:38.118588 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:38.118550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/must-gather-nqtqc" event={"ID":"27b74bf4-a05a-4ee0-9066-43ea065c15db","Type":"ContainerStarted","Data":"7fc7b6d8b8795838de4084f91d2f862c093169db8019fc0e6887dd053cfe98f1"}
Jul 15 23:01:38.118588 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:38.118596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/must-gather-nqtqc" event={"ID":"27b74bf4-a05a-4ee0-9066-43ea065c15db","Type":"ContainerStarted","Data":"741293f4fd427bfd6d5b1c0c908595b593467c78ff6c03f789e24d78bec52b6e"}
Jul 15 23:01:38.134913 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:38.134861    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxsw4/must-gather-nqtqc" podStartSLOduration=1.282053309 podStartE2EDuration="2.134841779s" totalImagesPullingTime="852.78847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:38.133255392 +0000 UTC m=+2713.373173151" watchObservedRunningTime="2026-07-15 23:01:38.134841779 +0000 UTC m=+2713.374759582"
Jul 15 23:01:38.430583 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:38.430481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log" limit=1024
Jul 15 23:01:39.348358 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:39.348328    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k4n6n_3ab3acd4-df38-4b05-8122-a00be2caeefd/global-pull-secret-syncer/0.log"
Jul 15 23:01:39.415845 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:39.415789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4xthk_4358b9e3-6422-4dd8-b06a-c8ca5eaf593b/konnectivity-agent/0.log"
Jul 15 23:01:39.559594 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:39.559564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-92.ec2.internal_fd167fdd0eb6d8c7e13b6472e5a2db0d/haproxy/0.log"
Jul 15 23:01:44.898729 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:44.898152    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c5bd55dfb-8tgdd_8d089c58-66a1-4d90-9330-1e1c19a8254e/authorino/0.log"
Jul 15 23:01:44.986793 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:44.986770    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vrjx2_2b9ebc8c-0948-4179-88c6-19343e7eb682/kuadrant-console-plugin/0.log"
Jul 15 23:01:45.211316 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:45.211247    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g7fkx_2b1addb6-8182-4556-8367-ebc15688ce93/limitador/0.log"
Jul 15 23:01:47.202434 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.202397    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-66lm6_5fb58813-5bd7-43a9-a83a-28b070f7dfee/kube-state-metrics/0.log"
Jul 15 23:01:47.250559 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.250527    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-66lm6_5fb58813-5bd7-43a9-a83a-28b070f7dfee/kube-rbac-proxy-main/0.log"
Jul 15 23:01:47.301257 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.301220    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-66lm6_5fb58813-5bd7-43a9-a83a-28b070f7dfee/kube-rbac-proxy-self/0.log"
Jul 15 23:01:47.375390 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.375354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-786df47645-njqg5_bc4be4c3-abc4-40d6-8168-853e182028d9/metrics-server/0.log"
Jul 15 23:01:47.462267 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.462180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-bzhdj_fd168b27-40c9-4850-9630-2cc2f06b1428/monitoring-plugin/0.log"
Jul 15 23:01:47.528973 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.528943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhfst_80bcb209-e532-4723-9d5e-68654aab2862/node-exporter/0.log"
Jul 15 23:01:47.570839 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.570813    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhfst_80bcb209-e532-4723-9d5e-68654aab2862/kube-rbac-proxy/0.log"
Jul 15 23:01:47.602044 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.601989    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dhfst_80bcb209-e532-4723-9d5e-68654aab2862/init-textfile/0.log"
Jul 15 23:01:47.905153 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.905122    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/prometheus/0.log"
Jul 15 23:01:47.931375 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.931347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/config-reloader/0.log"
Jul 15 23:01:47.955855 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.955822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/thanos-sidecar/0.log"
Jul 15 23:01:47.977474 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.977446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/kube-rbac-proxy-web/0.log"
Jul 15 23:01:47.999543 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:47.999520    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/kube-rbac-proxy/0.log"
Jul 15 23:01:48.020699 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:48.020669    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/kube-rbac-proxy-thanos/0.log"
Jul 15 23:01:48.042057 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:48.042006    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a94508ba-faba-44bb-8e32-093cfc409c43/init-config-reloader/0.log"
Jul 15 23:01:49.494719 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.494671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"]
Jul 15 23:01:49.499959 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.499932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.511971 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.511941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"]
Jul 15 23:01:49.589521 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.589481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-sys\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.589833 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.589804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-proc\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.590052 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.590032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz7pd\" (UniqueName: \"kubernetes.io/projected/33f8395d-5990-4854-8591-9f5366caefe2-kube-api-access-zz7pd\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.590238 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.590210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-lib-modules\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.590399 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.590375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-podres\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691173 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-sys\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691430 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-proc\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691627 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7pd\" (UniqueName: \"kubernetes.io/projected/33f8395d-5990-4854-8591-9f5366caefe2-kube-api-access-zz7pd\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691771 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-lib-modules\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691844 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-podres\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.691994 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-podres\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.692087 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-proc\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.692087 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.692040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-lib-modules\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.692087 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.691278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33f8395d-5990-4854-8591-9f5366caefe2-sys\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.699117 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.699092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7pd\" (UniqueName: \"kubernetes.io/projected/33f8395d-5990-4854-8591-9f5366caefe2-kube-api-access-zz7pd\") pod \"perf-node-gather-daemonset-6xspf\" (UID: \"33f8395d-5990-4854-8591-9f5366caefe2\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.815529 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.815498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:49.982630 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:49.982600    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"]
Jul 15 23:01:49.984339 ip-10-0-139-92 kubenswrapper[2565]: W0715 23:01:49.984311    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33f8395d_5990_4854_8591_9f5366caefe2.slice/crio-9125e9dd436d1ca58f8fb85b4f260b0fb9c85468884afd5416de7b2a8a9a8d32 WatchSource:0}: Error finding container 9125e9dd436d1ca58f8fb85b4f260b0fb9c85468884afd5416de7b2a8a9a8d32: Status 404 returned error can't find the container with id 9125e9dd436d1ca58f8fb85b4f260b0fb9c85468884afd5416de7b2a8a9a8d32
Jul 15 23:01:50.208911 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:50.208822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf" event={"ID":"33f8395d-5990-4854-8591-9f5366caefe2","Type":"ContainerStarted","Data":"4b7b072f9d916352d14530e27cd806e842d60be2f6dbeb5a311a2b09865a4402"}
Jul 15 23:01:50.208911 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:50.208878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf" event={"ID":"33f8395d-5990-4854-8591-9f5366caefe2","Type":"ContainerStarted","Data":"9125e9dd436d1ca58f8fb85b4f260b0fb9c85468884afd5416de7b2a8a9a8d32"}
Jul 15 23:01:50.208911 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:50.208902    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:50.224795 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:50.224740    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf" podStartSLOduration=1.224719857 podStartE2EDuration="1.224719857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:50.223334248 +0000 UTC m=+2725.463252008" watchObservedRunningTime="2026-07-15 23:01:50.224719857 +0000 UTC m=+2725.464637616"
Jul 15 23:01:52.322806 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:52.322774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzxq7_9df18e51-c4b8-47d5-8e80-6e1fcb021214/dns/0.log"
Jul 15 23:01:52.343183 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:52.343157    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzxq7_9df18e51-c4b8-47d5-8e80-6e1fcb021214/kube-rbac-proxy/0.log"
Jul 15 23:01:52.414387 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:52.414357    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kst97_4c4168e9-5194-49cc-87d2-d58a8a57fa65/dns-node-resolver/0.log"
Jul 15 23:01:52.927531 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:52.927496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5dffc4d584-qlnm8_624eca87-a31a-4360-90dc-ffcccc46724e/registry/0.log"
Jul 15 23:01:52.973394 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:52.973358    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mkr2m_975b931e-273b-4022-b8b1-5a966b02d870/node-ca/0.log"
Jul 15 23:01:54.057786 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:54.057753    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-pkh4g_22eb5a35-4db9-41e4-8397-6f3927e69174/kube-auth-proxy/0.log"
Jul 15 23:01:54.903576 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:54.903541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qgl6x_29c6e97d-23ad-4d91-a06a-d008f5b047de/serve-healthcheck-canary/0.log"
Jul 15 23:01:55.410423 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:55.410391    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vxcc_3362eef7-632f-4401-828e-4bdb260586f7/kube-rbac-proxy/0.log"
Jul 15 23:01:55.431030 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:55.430970    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vxcc_3362eef7-632f-4401-828e-4bdb260586f7/exporter/0.log"
Jul 15 23:01:55.452765 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:55.452735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2vxcc_3362eef7-632f-4401-828e-4bdb260586f7/extractor/0.log"
Jul 15 23:01:56.232932 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:56.232906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-6xspf"
Jul 15 23:01:58.023535 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:58.023489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hfj4r_68a61635-fe78-4c57-a97c-b43237fc51ee/manager/0.log"
Jul 15 23:01:58.220488 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:58.220447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-qcnfb_1e205520-a4e6-4a5e-a91b-272e481d8ed8/manager/0.log"
Jul 15 23:01:58.273474 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:58.273448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-qcnfb_1e205520-a4e6-4a5e-a91b-272e481d8ed8/copy-manifests/0.log"
Jul 15 23:01:59.783418 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:01:59.783384    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79bbf4474c-hf6zk_f6d532a8-66a4-4af4-a99d-d1827d47b85e/manager/0.log"
Jul 15 23:02:00.321046 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:00.320994    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-pkh4g_22eb5a35-4db9-41e4-8397-6f3927e69174/kube-auth-proxy/0.log"
Jul 15 23:02:01.779147 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:01.779116    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-pkh4g_22eb5a35-4db9-41e4-8397-6f3927e69174/kube-auth-proxy/0.log"
Jul 15 23:02:06.406136 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.406107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/kube-multus-additional-cni-plugins/0.log"
Jul 15 23:02:06.428677 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.428650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/egress-router-binary-copy/0.log"
Jul 15 23:02:06.452357 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.452331    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/cni-plugins/0.log"
Jul 15 23:02:06.475325 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.475296    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/bond-cni-plugin/0.log"
Jul 15 23:02:06.498234 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.498211    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/routeoverride-cni/0.log"
Jul 15 23:02:06.527738 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.527713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/whereabouts-cni-bincopy/0.log"
Jul 15 23:02:06.547917 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.547898    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-znc7r_b067aaff-5ccf-4e4c-84d4-f45517e6aa6a/whereabouts-cni/0.log"
Jul 15 23:02:06.617818 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.617786    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m45qq_53b39ae8-2f26-43a1-b878-1c2ce7604556/kube-multus/0.log"
Jul 15 23:02:06.671537 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.671462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6c8dc_7c541bf9-c370-4af5-a454-1755a1903793/network-metrics-daemon/0.log"
Jul 15 23:02:06.689786 ip-10-0-139-92 kubenswrapper[2565]: I0715 23:02:06.689767    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6c8dc_7c541bf9-c370-4af5-a454-1755a1903793/kube-rbac-proxy/0.log"