Sep 06 01:09:29.884469 ip-10-0-132-205 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 01:09:30.285505 ip-10-0-132-205 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:30.285505 ip-10-0-132-205 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 01:09:30.285505 ip-10-0-132-205 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:30.285505 ip-10-0-132-205 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 01:09:30.285505 ip-10-0-132-205 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:09:30.287089 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.286977    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 01:09:30.290806 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290791    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.290806 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290806    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290810    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290813    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290816    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290819    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290822    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290825    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290828    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290831    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290836    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290839    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290842    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290844    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290847    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290849    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290853    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290855    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290858    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290860    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290863    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.290868 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290866    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290868    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290871    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290875    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290878    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290881    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290883    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290886    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290889    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290891    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290894    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290896    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290898    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290901    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290905    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290909    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290912    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290915    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290917    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.291399 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290920    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290923    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290926    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290928    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290931    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290934    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290936    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290939    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290941    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290944    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290946    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290949    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290951    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290954    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290956    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290959    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290962    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290965    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290967    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290970    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.291872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290973    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290975    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290978    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290980    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290984    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290988    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290991    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290993    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290996    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.290999    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291001    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291004    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291006    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291009    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291012    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291014    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291017    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291020    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291023    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.292370 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291025    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291028    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291030    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291032    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291035    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291037    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291040    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291042    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291046    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291049    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291052    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291054    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291057    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291059    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291062    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291064    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291068    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291071    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291074    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.292825 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291077    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291808    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291815    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291818    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291821    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291824    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291826    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291829    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291832    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291835    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291837    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291840    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291842    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291845    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291847    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291850    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291853    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291855    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291857    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.293302 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291860    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291862    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291866    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291868    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291871    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291874    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291877    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291879    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291882    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291885    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291887    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291892    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291895    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291898    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291901    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291904    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291907    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291909    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291912    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.293791 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291914    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291917    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291919    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291922    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291925    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291927    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291930    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291933    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291936    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291938    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291941    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291943    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291946    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291949    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291951    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291954    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291957    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291960    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291962    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291965    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.294260 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291967    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291970    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291973    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291975    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291978    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291980    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291982    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291985    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291987    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291992    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291995    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.291997    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292000    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292003    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292006    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292008    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292011    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292015    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292019    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.294750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292022    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292025    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292028    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292031    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292033    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292036    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292039    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292041    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292044    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292047    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292049    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292052    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292054    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292056    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292059    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292061    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292064    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292066    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292072    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292074    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.295220 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292076    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292079    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292081    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292437    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292443    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292446    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292449    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292452    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292454    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292458    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292461    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292463    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292466    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292469    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292471    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292474    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292477    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292479    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292483    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.295707 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292487    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292490    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292493    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292496    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292499    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292501    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292504    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292506    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292509    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292511    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292514    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292517    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292521    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292524    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292526    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292529    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292532    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292536    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292539    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292541    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.296164 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292544    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292547    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292549    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292553    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292556    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292559    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292561    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292564    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292567    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292569    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292572    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292574    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292576    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292579    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292581    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292586    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292589    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292592    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292595    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292598    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.296668 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292600    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292603    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292605    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292608    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292610    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292613    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292615    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292618    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292620    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292624    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292626    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292629    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292631    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292634    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292637    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292641    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292645    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292648    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292650    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.297155 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292653    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292656    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292658    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292661    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292663    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292666    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292668    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292671    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292673    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292676    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292678    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292681    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292684    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292686    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292689    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292691    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292696    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292699    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.297624 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292701    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292704    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292706    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292710    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.292712    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292787    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292834    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292842    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292846    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292853    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292856    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292861    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292865    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292868    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292871    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292874    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292877    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292880    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292883    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292886    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292889    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292892    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292895    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 01:09:30.298080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292899    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292902    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292905    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292908    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292911    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292915    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292918    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292921    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292924    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292927    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292930    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292933    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292937    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292939    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292943    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292946    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292949    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292952    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292956    2582 flags.go:64] FLAG: --enable-server="true"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292959    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292964    2582 flags.go:64] FLAG: --event-burst="100"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292967    2582 flags.go:64] FLAG: --event-qps="50"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292970    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292973    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 01:09:30.298632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292976    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292979    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292982    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292985    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292988    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292990    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292993    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292996    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.292999    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293002    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293005    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293007    2582 flags.go:64] FLAG: --feature-gates=""
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293011    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293014    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293017    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293020    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293023    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293026    2582 flags.go:64] FLAG: --help="false"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293029    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293032    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293035    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293038    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293042    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 01:09:30.299253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293045    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293048    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293050    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293054    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293057    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293060    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293063    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293067    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293070    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293072    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293075    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293078    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293081    2582 flags.go:64] FLAG: --lock-file=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293083    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293086    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293089    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293094    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293097    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293100    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293103    2582 flags.go:64] FLAG: --logging-format="text"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293105    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293109    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293111    2582 flags.go:64] FLAG: --manifest-url=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293114    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293118    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 01:09:30.299844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293121    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293125    2582 flags.go:64] FLAG: --max-pods="110"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293128    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293131    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293134    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293137    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293140    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293143    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293146    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293153    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293157    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293160    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293163    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293166    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293171    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293188    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293191    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293194    2582 flags.go:64] FLAG: --port="10250"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293197    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293200    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c9f6a58c0e18c671"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293203    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293206    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293209    2582 flags.go:64] FLAG: --register-node="true"
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293212    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 06 01:09:30.300464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293215    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293218    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293221    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293224    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293227    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293230    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293233    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293236    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293239    2582 flags.go:64] FLAG: --runonce="false"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293242    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293245    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293248    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293251    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293254    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293257    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293260    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293263    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293266    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293269    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293273    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293275    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293278    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293281    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293284    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293290    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 01:09:30.301043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293293    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293296    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293300    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293302    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293305    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293308    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293311    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293314    2582 flags.go:64] FLAG: --v="2"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293318    2582 flags.go:64] FLAG: --version="false"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293322    2582 flags.go:64] FLAG: --vmodule=""
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293325    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293328    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293455    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293459    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293462    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293464    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293467    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293470    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293473    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293477    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293480    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293482    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.301917 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293485    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293487    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293490    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293492    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293496    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293499    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293502    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293504    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293507    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293509    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293517    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293520    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293522    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293525    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293527    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293530    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293532    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293535    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293538    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293540    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.302558 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293543    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293545    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293548    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293550    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293553    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293555    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293558    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293560    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293563    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293566    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293569    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293571    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293574    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293576    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293578    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293581    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293585    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293589    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293592    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.303103 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293595    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293598    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293601    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293611    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293614    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293617    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293620    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293623    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293625    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293628    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293631    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293635    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293637    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293640    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293643    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293645    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293647    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293651    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293655    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.303602 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293658    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293661    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293663    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293668    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293671    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293674    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293676    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293679    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293681    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293684    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293688    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293690    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293693    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293696    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293698    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293701    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293704    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293706    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293709    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293712    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.304067 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293714    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293717    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293719    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293722    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293724    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293727    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293729    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293732    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293734    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293737    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.293739    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.293744    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.303635    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.303650    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.304228    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 01:09:30.304576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.304240    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304295    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304301    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304304    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304307    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304310    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304313    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304315    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304318    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304321    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304324    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304327    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304329    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304332    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304335    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304337    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304340    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304343    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304345    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304348    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.304954 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304350    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304354    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304358    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304361    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304364    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304367    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304369    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304372    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304379    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304382    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304385    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304388    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304391    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304394    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304396    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304399    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304402    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304404    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304407    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.305455 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304409    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304412    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304414    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304417    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304419    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304422    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304424    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304427    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304429    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304433    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304436    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304440    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304442    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304445    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304448    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304450    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304453    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304455    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304457    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304460    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.305906 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304463    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304465    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304467    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304471    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304475    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304479    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304481    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304484    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304486    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304489    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304491    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304494    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304496    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304499    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304501    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304504    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304506    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304509    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304511    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304514    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.306428 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304516    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304520    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304523    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304525    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304528    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304530    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304533    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304535    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304537    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304540    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304542    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304545    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304547    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304550    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304552    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304555    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304558    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304561    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304563    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304566    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.306914 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304569    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.304574    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304705    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304712    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304715    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304718    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304721    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304724    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304727    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304729    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304732    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304735    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304737    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304739    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304743    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:09:30.307396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304745    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304748    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304751    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304753    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304756    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304758    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304761    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304763    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304766    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304770    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304773    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304776    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304779    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304783    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304785    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304788    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304791    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304793    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304796    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:09:30.307763 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304799    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304801    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304804    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304807    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304809    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304812    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304814    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304816    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304819    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304822    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304824    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304827    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304829    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304833    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304835    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304838    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304840    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304843    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304845    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304848    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:09:30.308396 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304850    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304853    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304855    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304858    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304860    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304863    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304865    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304868    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304871    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304873    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304876    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304878    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304881    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304883    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304886    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304888    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304892    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304895    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304898    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304901    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:09:30.308886 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304904    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304907    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304909    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304912    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304915    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304918    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304921    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304923    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304926    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304929    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304931    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304933    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304936    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304938    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304941    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304943    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304945    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304948    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304951    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304953    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:09:30.309400 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304956    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304960    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304964    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304966    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304969    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304971    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:30.304974    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.304979    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.305078    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.308334    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.309362    2582 server.go:1019] "Starting client certificate rotation"
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.309459    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:09:30.309882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.309498    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:09:30.311937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.311924    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:09:30.315782 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.315769    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:09:30.327744 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.327633    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 06 01:09:30.330903 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.330886    2582 log.go:25] "Validated CRI v1 image API"
Sep 06 01:09:30.331737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.331724    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 01:09:30.335885 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.335869    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:09:30.337218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.337200    2582 fs.go:135] Filesystem UUIDs: map[022fb3f9-6a4d-40d5-a35c-43868caa9de5:/dev/nvme0n1p4 46638c54-ff57-4b3a-aeaf-14675aa6ee23:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 06 01:09:30.337265 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.337218    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 01:09:30.343042 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.342943    2582 manager.go:216] Machine: {Timestamp:2026-09-06 01:09:30.340681427 +0000 UTC m=+0.343162985 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3058302 MemoryCapacity:32812142592 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20c1111d9507394fa9263f4e6e5611 SystemUUID:ec20c111-1d95-0739-4fa9-263f4e6e5611 BootID:9039d1bf-3e75-4a62-a85d-8eaa0412fea4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406069248 Type:vfs Inodes:4005388 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406073344 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:26:fe:92:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:26:fe:92:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:0f:b5:bc:91:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812142592 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 01:09:30.343042 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.343038    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 01:09:30.343158 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.343146    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 01:09:30.344263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.344240    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 01:09:30.344394 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.344266    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 01:09:30.345474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.345464    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 01:09:30.345505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.345477    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 01:09:30.345505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.345485    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:09:30.346132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.346122    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:09:30.347448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.347439    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 01:09:30.350507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350496    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:09:30.350628 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350619    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 01:09:30.350661 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350649    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 01:09:30.350691 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350663    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 01:09:30.350691 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350681    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 01:09:30.350743 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350694    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 06 01:09:30.350743 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.350706    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 01:09:30.353325 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.353299    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:09:30.353422 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.353342    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:09:30.356601 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.356582    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 01:09:30.358738 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358720    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 01:09:30.358806 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.358740    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 01:09:30.358806 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358760    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 01:09:30.358806 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.358779    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358898    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358909    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358916    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358921    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358929    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 01:09:30.358932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.358935    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 01:09:30.359348 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359339    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 01:09:30.359348 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359348    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 01:09:30.359408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359355    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 01:09:30.359408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359360    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 01:09:30.359408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359368    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 01:09:30.359408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.359375    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 01:09:30.360202 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.360174    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 01:09:30.360202 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.360201    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 01:09:30.363936 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.363924    2582 server.go:1268] "Started kubelet"
Sep 06 01:09:30.364044 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.363997    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 01:09:30.364101 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.364064    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 01:09:30.364219 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.364160    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 01:09:30.364768 ip-10-0-132-205 systemd[1]: Started Kubernetes Kubelet.
Sep 06 01:09:30.366347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.366330    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 01:09:30.367431 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.367410    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 01:09:30.371742 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.371728    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 01:09:30.373528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373026    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvj2r"
Sep 06 01:09:30.373528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373047    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 01:09:30.373528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373056    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvj2r"
Sep 06 01:09:30.373528 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.373070    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.373819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373574    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 01:09:30.373959 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373943    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 01:09:30.374007 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.373962    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 01:09:30.374063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374047    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 01:09:30.374108 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374064    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 01:09:30.374282 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374265    2582 factory.go:55] Registering systemd factory
Sep 06 01:09:30.374333 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374305    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 06 01:09:30.374523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374507    2582 factory.go:153] Registering CRI-O factory
Sep 06 01:09:30.374523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374524    2582 factory.go:223] Registration of the crio container factory successfully
Sep 06 01:09:30.374644 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.374534    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 01:09:30.374644 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374585    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 01:09:30.374644 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374602    2582 factory.go:103] Registering Raw factory
Sep 06 01:09:30.374778 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.374671    2582 manager.go:1196] Started watching for new ooms in manager
Sep 06 01:09:30.375086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.375073    2582 manager.go:349] Starting recovery of all containers
Sep 06 01:09:30.376076 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.376035    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 01:09:30.376362 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.376340    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 01:09:30.376519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.376505    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 01:09:30.377017 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.376006    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-205.ec2.internal.18d29609af9107d9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-205.ec2.internal,UID:ip-10-0-132-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-205.ec2.internal,},FirstTimestamp:2026-09-06 01:09:30.363897817 +0000 UTC m=+0.366379375,LastTimestamp:2026-09-06 01:09:30.363897817 +0000 UTC m=+0.366379375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-205.ec2.internal,}"
Sep 06 01:09:30.387148 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.387129    2582 manager.go:354] Recovery completed
Sep 06 01:09:30.391363 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.391351    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.392799 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.392782    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.392863 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.392810    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.392863 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.392821    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.393476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.393354    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 01:09:30.393476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.393364    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 01:09:30.393476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.393381    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:09:30.393476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.393356    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.394144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394129    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.394248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394155    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.394248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394166    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.394454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394439    2582 policy_none.go:49] "None policy: Start"
Sep 06 01:09:30.394454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394455    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 01:09:30.394548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.394465    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 01:09:30.395512 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.395501    2582 policy_none.go:47] "Start"
Sep 06 01:09:30.427746 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.427732    2582 manager.go:337] "Starting Device Plugin manager"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.427767    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.427780    2582 server.go:87] "Starting device plugin registration server"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.428020    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.428034    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.428121    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.428220    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.428230    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.428736    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 01:09:30.451987 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.428788    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.469012 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.468986    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 01:09:30.470299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.470282    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 01:09:30.470376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.470337    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 01:09:30.470376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.470364    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 01:09:30.470473 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.470412    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 01:09:30.472615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.472592    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:30.528466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.528446    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.530423 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.530406    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.530510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.530440    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.530510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.530455    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.530510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.530483    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.539169 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.539108    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.539169 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.539128    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-205.ec2.internal\": node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.551708 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.551689    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.570608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.570589    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"]
Sep 06 01:09:30.570658 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.570644    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.574960 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.574944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.575398 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.575385    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.575457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.575408    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.575457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.575417    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.577644 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.577632    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.577759 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.577743    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.577808 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.577774    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.578376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578360    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.578440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578384    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.578440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578393    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.578440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578360    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.578533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578460    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.578533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.578471    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.580429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.580413    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.580508 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.580448    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:09:30.581594 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.581575    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:09:30.581680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.581604    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:09:30.581680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.581619    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:09:30.607736 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.607710    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-205.ec2.internal\" not found" node="ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.611507 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.611488    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-205.ec2.internal\" not found" node="ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.652554 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.652532    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.675895 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.675875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.675989 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.675904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.675989 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.675921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.675989 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.675962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/eaef65e55aa5f7053cfe7a3a8e382309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-205.ec2.internal\" (UID: \"eaef65e55aa5f7053cfe7a3a8e382309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.753050 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.753021    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.776337 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.776320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.776389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.776342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.776389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.776364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.776389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.776384    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356d70d76887b88988d30ee1a1b2cbfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal\" (UID: \"356d70d76887b88988d30ee1a1b2cbfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.853723 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.853640    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:30.910157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.910122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.914614 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:30.914449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:30.954160 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:30.954136    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.054676 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.054630    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.155111 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.155084    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.203789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.203760    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:31.255831 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.255808    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.309263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.309246    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 01:09:31.309662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.309362    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:09:31.309662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.309380    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:09:31.344522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.344493    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:31.356074 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.356052    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.375359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.375315    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 01:04:30 +0000 UTC" deadline="2028-06-05 12:59:55.306517062 +0000 UTC"
Sep 06 01:09:31.375359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.375354    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15323h50m23.931165931s"
Sep 06 01:09:31.432528 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:31.432498    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaef65e55aa5f7053cfe7a3a8e382309.slice/crio-8a4c262dfa1afc4bffc7b552fae6e2e7cc661fdfc390950e0364c9d4e810bc73 WatchSource:0}: Error finding container 8a4c262dfa1afc4bffc7b552fae6e2e7cc661fdfc390950e0364c9d4e810bc73: Status 404 returned error can't find the container with id 8a4c262dfa1afc4bffc7b552fae6e2e7cc661fdfc390950e0364c9d4e810bc73
Sep 06 01:09:31.432703 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:31.432687    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356d70d76887b88988d30ee1a1b2cbfb.slice/crio-9059be9f460a5d4b08e3749717ad606f96596831deecb3c446020c2c492ccbb5 WatchSource:0}: Error finding container 9059be9f460a5d4b08e3749717ad606f96596831deecb3c446020c2c492ccbb5: Status 404 returned error can't find the container with id 9059be9f460a5d4b08e3749717ad606f96596831deecb3c446020c2c492ccbb5
Sep 06 01:09:31.438313 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.438297    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:09:31.457141 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.457121    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.474306 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.474261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerStarted","Data":"9059be9f460a5d4b08e3749717ad606f96596831deecb3c446020c2c492ccbb5"}
Sep 06 01:09:31.475286 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.475267    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" event={"ID":"eaef65e55aa5f7053cfe7a3a8e382309","Type":"ContainerStarted","Data":"8a4c262dfa1afc4bffc7b552fae6e2e7cc661fdfc390950e0364c9d4e810bc73"}
Sep 06 01:09:31.557599 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:31.557571    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-205.ec2.internal\" not found"
Sep 06 01:09:31.657425 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.657397    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:31.673901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.673698    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:31.684324 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.684299    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:09:31.685289 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.685279    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal"
Sep 06 01:09:31.696875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:31.696854    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:09:32.351866 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.351834    2582 apiserver.go:52] "Watching apiserver"
Sep 06 01:09:32.360727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.360356    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 01:09:32.362731 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.362689    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr","openshift-cluster-node-tuning-operator/tuned-gtcnk","openshift-dns/node-resolver-b878j","openshift-multus/multus-pwtlg","openshift-ovn-kubernetes/ovnkube-node-js5jq","kube-system/global-pull-secret-syncer-n97kl","kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal","openshift-image-registry/node-ca-4l89g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal","openshift-multus/multus-additional-cni-plugins-84fq4","openshift-multus/network-metrics-daemon-8nxgv","openshift-network-diagnostics/network-check-target-jfdkq","openshift-network-operator/iptables-alerter-pkqv5","kube-system/konnectivity-agent-4w6lh"]
Sep 06 01:09:32.365444 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.365420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.368253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.367839    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.368848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.368829    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.369172 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.369149    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 01:09:32.369397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.369381    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.369555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.369538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 01:09:32.369625 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.369567    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 01:09:32.369960 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.369826    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zv2dw\""
Sep 06 01:09:32.372894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.370571    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.372894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.370825    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.372894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.371015    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmrkw\""
Sep 06 01:09:32.372894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.372287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.373273 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.373250    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 01:09:32.374530 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.374500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.375347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.374834    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.375347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.374909    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.375347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.374871    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qqfg6\""
Sep 06 01:09:32.377237 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.377217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.377743 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.377726    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 01:09:32.378992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.378972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhvxk\""
Sep 06 01:09:32.379992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.379706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.382980 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.382957    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.383195 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383179    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 01:09:32.383321 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383303    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 01:09:32.383407 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383394    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.383693 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 01:09:32.383739 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.383844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:32.383880 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snz4s\""
Sep 06 01:09:32.383950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.383931    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 01:09:32.384021 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.383931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:32.384131 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.384114    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hw54n\""
Sep 06 01:09:32.384373 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.384356    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.385844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.385825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.385928 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.385830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-host\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.385976 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.385950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-kubernetes\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.386013 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.385981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-systemd\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.386069 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hqs\" (UniqueName: \"kubernetes.io/projected/8bece91b-4b27-4ecc-8354-480f069ddde3-kube-api-access-l4hqs\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.386109 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.385841    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:09:32.386367 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-bin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-kubelet\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-hostroot\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-etc-kubernetes\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386710 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386578    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-tmp\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.386710 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-conf-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-daemon-config\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-system-cni-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.386921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-tuned\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.386921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cni-binary-copy\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.386921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386893    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-netns\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmdf\" (UniqueName: \"kubernetes.io/projected/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-kube-api-access-9qmdf\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.386991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-run\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-lib-modules\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.387100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-var-lib-kubelet\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-multus-certs\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-cnibin\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-binary-copy\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-conf\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-sys\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.387426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec82469a-1c83-488e-a8e9-6b52fda99171-hosts-file\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-k8s-cni-cncf-io\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-multus\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqs7\" (UniqueName: \"kubernetes.io/projected/32bf690a-fb1a-476b-ac49-fa259b79d885-kube-api-access-dnqs7\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387546    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsq9d\" (UniqueName: \"kubernetes.io/projected/ec82469a-1c83-488e-a8e9-6b52fda99171-kube-api-access-fsq9d\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-system-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cnibin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-socket-dir-parent\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.387736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.388136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.388136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387800    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec82469a-1c83-488e-a8e9-6b52fda99171-tmp-dir\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.388136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387847    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-modprobe-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.388136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysconfig\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.388136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.387892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.388476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.388457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpr2g\""
Sep 06 01:09:32.389549 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.389250    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 01:09:32.389549 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.389288    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.389982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.389960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.391424 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.391401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.392813 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.392793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.392920 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.392869    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:32.393197 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.393178    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 01:09:32.393381 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.393363    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 01:09:32.393791 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.393774    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 01:09:32.393938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.393923    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qglvk\""
Sep 06 01:09:32.395395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.395260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.395395 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.395349    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:32.397972 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.397950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.400586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.400565    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 01:09:32.401226 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.400843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgvw6\""
Sep 06 01:09:32.401226 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.400990    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 01:09:32.408294 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.408263    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2895g"
Sep 06 01:09:32.417651 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.417628    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2895g"
Sep 06 01:09:32.474707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.474687    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 01:09:32.488059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec82469a-1c83-488e-a8e9-6b52fda99171-tmp-dir\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l6hn\" (UniqueName: \"kubernetes.io/projected/c295b51f-eedb-40f8-b427-4d940dffc043-kube-api-access-2l6hn\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-dbus\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-netns\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-modprobe-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysconfig\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-device-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-bin\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-systemd\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488397    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-bin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-host-slash\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovn-node-metrics-cert\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-conf-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-log-socket\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.488586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-netd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-tuned\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-netns\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmdf\" (UniqueName: \"kubernetes.io/projected/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-kube-api-access-9qmdf\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-config\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-run\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-lib-modules\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-kubelet\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-node-log\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvpfc\" (UniqueName: \"kubernetes.io/projected/f9b7fd35-4f46-4f4e-b217-84a964bad302-kube-api-access-qvpfc\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-binary-copy\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-conf\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-multus\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.488979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-slash\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.489232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-tuning-conf-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec82469a-1c83-488e-a8e9-6b52fda99171-tmp-dir\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqs7\" (UniqueName: \"kubernetes.io/projected/32bf690a-fb1a-476b-ac49-fa259b79d885-kube-api-access-dnqs7\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489184    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysconfig\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489228    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-modprobe-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-bin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-systemd\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-conf-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-netns\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsq9d\" (UniqueName: \"kubernetes.io/projected/ec82469a-1c83-488e-a8e9-6b52fda99171-kube-api-access-fsq9d\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-system-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvtd\" (UniqueName: \"kubernetes.io/projected/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-kube-api-access-xwvtd\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-systemd-units\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-var-lib-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-run\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-lib-modules\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489647    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-conf\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-system-cni-dir\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.489810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-cni-multus\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490208    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490334    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-binary-copy\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-iptables-alerter-script\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-systemd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-host\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c295b51f-eedb-40f8-b427-4d940dffc043-host\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490561    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-host\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-kubelet-config\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-sysctl-d\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-kubernetes\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.490978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490724    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hqs\" (UniqueName: \"kubernetes.io/projected/8bece91b-4b27-4ecc-8354-480f069ddde3-kube-api-access-l4hqs\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490779    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-kubernetes\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-kubelet\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-hostroot\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-var-lib-kubelet\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-etc-kubernetes\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-etc-kubernetes\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-sys-fs\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.490998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-hostroot\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.491010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqpb\" (UniqueName: \"kubernetes.io/projected/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kube-api-access-xwqpb\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.491042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-tmp\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.491753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.491749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-daemon-config\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.492331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.491794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-socket-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.492331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.491826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-etc-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.492331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.492272    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-daemon-config\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.492989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-system-cni-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cni-binary-copy\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493086    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3abc434c-0079-4166-b374-2e2093fc4b8f-agent-certs\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-system-cni-dir\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3abc434c-0079-4166-b374-2e2093fc4b8f-konnectivity-ca\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32bf690a-fb1a-476b-ac49-fa259b79d885-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-var-lib-kubelet\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-multus-certs\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cni-binary-copy\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c295b51f-eedb-40f8-b427-4d940dffc043-serviceca\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-multus-certs\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493945    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-var-lib-kubelet\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.493985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-ovn\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-cnibin\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-sys\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.495519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec82469a-1c83-488e-a8e9-6b52fda99171-hosts-file\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-k8s-cni-cncf-io\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmxdl\" (UniqueName: \"kubernetes.io/projected/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-kube-api-access-wmxdl\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-env-overrides\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-script-lib\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cnibin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-socket-dir-parent\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-registration-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32bf690a-fb1a-476b-ac49-fa259b79d885-cnibin\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bece91b-4b27-4ecc-8354-480f069ddde3-sys\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec82469a-1c83-488e-a8e9-6b52fda99171-hosts-file\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-host-run-k8s-cni-cncf-io\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-cnibin\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.494892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-multus-socket-dir-parent\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.495012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-etc-tuned\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.496359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.495664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bece91b-4b27-4ecc-8354-480f069ddde3-tmp\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.498466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.498438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsq9d\" (UniqueName: \"kubernetes.io/projected/ec82469a-1c83-488e-a8e9-6b52fda99171-kube-api-access-fsq9d\") pod \"node-resolver-b878j\" (UID: \"ec82469a-1c83-488e-a8e9-6b52fda99171\") " pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.500629 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.500607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hqs\" (UniqueName: \"kubernetes.io/projected/8bece91b-4b27-4ecc-8354-480f069ddde3-kube-api-access-l4hqs\") pod \"tuned-gtcnk\" (UID: \"8bece91b-4b27-4ecc-8354-480f069ddde3\") " pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.500725 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.500704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmdf\" (UniqueName: \"kubernetes.io/projected/95f55eea-24f9-4bec-b10b-ee2dc119ba9c-kube-api-access-9qmdf\") pod \"multus-pwtlg\" (UID: \"95f55eea-24f9-4bec-b10b-ee2dc119ba9c\") " pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.500770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.500739    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqs7\" (UniqueName: \"kubernetes.io/projected/32bf690a-fb1a-476b-ac49-fa259b79d885-kube-api-access-dnqs7\") pod \"multus-additional-cni-plugins-84fq4\" (UID: \"32bf690a-fb1a-476b-ac49-fa259b79d885\") " pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.557448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.557416    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:32.595230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-slash\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595345 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595345 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvtd\" (UniqueName: \"kubernetes.io/projected/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-kube-api-access-xwvtd\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.595345 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-systemd-units\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-var-lib-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-slash\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-systemd-units\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-var-lib-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-iptables-alerter-script\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.595490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-systemd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c295b51f-eedb-40f8-b427-4d940dffc043-host\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-systemd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595546    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-kubelet-config\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-kubelet-config\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-sys-fs\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c295b51f-eedb-40f8-b427-4d940dffc043-host\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.595647    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqpb\" (UniqueName: \"kubernetes.io/projected/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kube-api-access-xwqpb\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-socket-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-etc-selinux\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-sys-fs\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.595726    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:33.09570238 +0000 UTC m=+3.098183947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:32.595769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-etc-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3abc434c-0079-4166-b374-2e2093fc4b8f-agent-certs\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-socket-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3abc434c-0079-4166-b374-2e2093fc4b8f-konnectivity-ca\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c295b51f-eedb-40f8-b427-4d940dffc043-serviceca\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-etc-openvswitch\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-ovn\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmxdl\" (UniqueName: \"kubernetes.io/projected/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-kube-api-access-wmxdl\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-env-overrides\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-run-ovn\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-script-lib\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.595992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-registration-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l6hn\" (UniqueName: \"kubernetes.io/projected/c295b51f-eedb-40f8-b427-4d940dffc043-kube-api-access-2l6hn\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-iptables-alerter-script\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-dbus\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-netns\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-registration-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.596648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-device-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596162    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-bin\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-host-slash\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-netns\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-run-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3abc434c-0079-4166-b374-2e2093fc4b8f-konnectivity-ca\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-host-slash\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovn-node-metrics-cert\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c295b51f-eedb-40f8-b427-4d940dffc043-serviceca\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c731e94b-ea94-46f5-975a-7a356865f7db-dbus\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9604cca2-33e5-49c6-b3e3-842ec8a1b125-device-dir\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-log-socket\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-netd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.596480    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:32.597305 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-config\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-log-socket\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.596543    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:09:33.096525153 +0000 UTC m=+3.099006702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-netd\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-script-lib\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-kubelet\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-node-log\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvpfc\" (UniqueName: \"kubernetes.io/projected/f9b7fd35-4f46-4f4e-b217-84a964bad302-kube-api-access-qvpfc\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-cni-bin\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-node-log\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-env-overrides\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596717    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9b7fd35-4f46-4f4e-b217-84a964bad302-host-kubelet\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.596746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:32.597847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.597205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovnkube-config\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.598780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.598755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9b7fd35-4f46-4f4e-b217-84a964bad302-ovn-node-metrics-cert\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.598995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.598969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3abc434c-0079-4166-b374-2e2093fc4b8f-agent-certs\") pod \"konnectivity-agent-4w6lh\" (UID: \"3abc434c-0079-4166-b374-2e2093fc4b8f\") " pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:32.608127 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.608071    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqpb\" (UniqueName: \"kubernetes.io/projected/9604cca2-33e5-49c6-b3e3-842ec8a1b125-kube-api-access-xwqpb\") pod \"aws-ebs-csi-driver-node-l2nhr\" (UID: \"9604cca2-33e5-49c6-b3e3-842ec8a1b125\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.608706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.608670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmxdl\" (UniqueName: \"kubernetes.io/projected/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-kube-api-access-wmxdl\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:32.608815 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.608726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvtd\" (UniqueName: \"kubernetes.io/projected/be6ef7e8-c8d0-41b3-b2ce-64768521d9cc-kube-api-access-xwvtd\") pod \"iptables-alerter-pkqv5\" (UID: \"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc\") " pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.610128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.609854    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:32.610128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.609881    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:32.610128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.609899    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:32.610128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:32.609965    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:33.109948944 +0000 UTC m=+3.112430494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:32.611998 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.611976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvpfc\" (UniqueName: \"kubernetes.io/projected/f9b7fd35-4f46-4f4e-b217-84a964bad302-kube-api-access-qvpfc\") pod \"ovnkube-node-js5jq\" (UID: \"f9b7fd35-4f46-4f4e-b217-84a964bad302\") " pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.613022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.612998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l6hn\" (UniqueName: \"kubernetes.io/projected/c295b51f-eedb-40f8-b427-4d940dffc043-kube-api-access-2l6hn\") pod \"node-ca-4l89g\" (UID: \"c295b51f-eedb-40f8-b427-4d940dffc043\") " pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.679540 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.679514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-84fq4"
Sep 06 01:09:32.687358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.687336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtcnk"
Sep 06 01:09:32.697396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.697338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b878j"
Sep 06 01:09:32.707435 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.707407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pwtlg"
Sep 06 01:09:32.715737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.715717    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:32.725568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.725550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4l89g"
Sep 06 01:09:32.733770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.733751    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pkqv5"
Sep 06 01:09:32.742503 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.742480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr"
Sep 06 01:09:32.750327 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:32.750312    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:33.100946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.100916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:33.101142 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.100980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:33.101142 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.101090    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:33.101142 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.101091    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:33.101313 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.101146    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:09:34.101132769 +0000 UTC m=+4.103614315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:33.101313 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.101161    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:34.101154695 +0000 UTC m=+4.103636241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:33.201981 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.201946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:33.202172 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.202126    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:33.202255 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.202182    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:33.202255 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.202213    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:33.202358 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.202287    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:34.20226502 +0000 UTC m=+4.204746571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:33.421671 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.421630    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:04:32 +0000 UTC" deadline="2028-02-06 03:38:11.524671693 +0000 UTC"
Sep 06 01:09:33.421671 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.421669    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12434h28m38.103010339s"
Sep 06 01:09:33.471319 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.471287    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:33.471454 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:33.471425    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:33.620120 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:33.620082    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:09:33.781789 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:09:33.781759    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bece91b_4b27_4ecc_8354_480f069ddde3.slice/crio-1b714a3f7271f1652c194f7b94107fb3584c424d589f380a634d7803994018c6 WatchSource:0}: Error finding container 1b714a3f7271f1652c194f7b94107fb3584c424d589f380a634d7803994018c6: Status 404 returned error can't find the container with id 1b714a3f7271f1652c194f7b94107fb3584c424d589f380a634d7803994018c6
Sep 06 01:09:34.108660 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.108630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:34.108752 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.108682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:34.108800 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.108785    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:34.108800 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.108785    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:34.108866 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.108847    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:36.108828692 +0000 UTC m=+6.111310253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:34.108909 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.108865    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:09:36.10885545 +0000 UTC m=+6.111336996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:34.208965 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.208931    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:34.209116 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.209099    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:34.209178 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.209123    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:34.209178 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.209135    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:34.209265 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.209182    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:36.209168374 +0000 UTC m=+6.211649919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:34.422455 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.422361    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:04:32 +0000 UTC" deadline="2028-04-14 07:19:39.638576241 +0000 UTC"
Sep 06 01:09:34.422455 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.422423    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14070h10m5.216157899s"
Sep 06 01:09:34.472022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.471322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:34.472022 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.471451    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:34.472022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.471862    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:34.472022 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:34.471973    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:34.489787 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.489753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr" event={"ID":"9604cca2-33e5-49c6-b3e3-842ec8a1b125","Type":"ContainerStarted","Data":"5293ab4d528ef20315a70ec2ddc12f8fb48ac457b6e314cfad9ab8deb3720ecb"}
Sep 06 01:09:34.500952 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.500920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerStarted","Data":"27e9d7fe00cf3f0d1a0f4f93525e067f6722a7832f8da394a4c7caadc5364c9d"}
Sep 06 01:09:34.505961 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.505934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4w6lh" event={"ID":"3abc434c-0079-4166-b374-2e2093fc4b8f","Type":"ContainerStarted","Data":"2886a91f6af12c33589f8cdaa6ca79783ab5c6f40f5c3742d91811fad2e0eee2"}
Sep 06 01:09:34.520948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.520918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"8aa7e0d4f4803b11b7dc4083b5158febd3d08d34b45d3b8a1cf7cee91d5b2421"}
Sep 06 01:09:34.531303 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.531269    2582 generic.go:356] "Generic (PLEG): container finished" podID="356d70d76887b88988d30ee1a1b2cbfb" containerID="c22338170194136457293a5491a528f741135a33dd90a14b8ff24440d2cb6d1f" exitCode=0
Sep 06 01:09:34.531416 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.531357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerDied","Data":"c22338170194136457293a5491a528f741135a33dd90a14b8ff24440d2cb6d1f"}
Sep 06 01:09:34.546778 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.546750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b878j" event={"ID":"ec82469a-1c83-488e-a8e9-6b52fda99171","Type":"ContainerStarted","Data":"2a259607be3c73ec7fcc5680ffe35f6b13afa2823951c6dd8799c8c4091afc6c"}
Sep 06 01:09:34.562179 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.562145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwtlg" event={"ID":"95f55eea-24f9-4bec-b10b-ee2dc119ba9c","Type":"ContainerStarted","Data":"fb0b24c39948bbcf832afe8419a6a7f3fe403c17b987c07eb0baab83a0c5e9d4"}
Sep 06 01:09:34.575924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.575886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkqv5" event={"ID":"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc","Type":"ContainerStarted","Data":"94ece2cf5513e83851b763c4d9b85f094aa8e1219391375e752eb475d4a17c50"}
Sep 06 01:09:34.595233 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.595176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtcnk" event={"ID":"8bece91b-4b27-4ecc-8354-480f069ddde3","Type":"ContainerStarted","Data":"1b714a3f7271f1652c194f7b94107fb3584c424d589f380a634d7803994018c6"}
Sep 06 01:09:34.624894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.624854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" event={"ID":"eaef65e55aa5f7053cfe7a3a8e382309","Type":"ContainerStarted","Data":"bed647bfe1e49aefb0c6251f635b0f974ec78d1f83ab899bd76adac26d17ccbe"}
Sep 06 01:09:34.631940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:34.631706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4l89g" event={"ID":"c295b51f-eedb-40f8-b427-4d940dffc043","Type":"ContainerStarted","Data":"bb70a919f2b236836e7b3e19a174171613f4af15e225bebd7d11dba06c18c34a"}
Sep 06 01:09:35.471129 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:35.470871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:35.471649 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:35.471249    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:35.645934 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:35.645893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" event={"ID":"356d70d76887b88988d30ee1a1b2cbfb","Type":"ContainerStarted","Data":"ea329eab3637898216527473fca02b3add3d42b5e1d18e588b177cc4ac47f220"}
Sep 06 01:09:35.663232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:35.663160    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-205.ec2.internal" podStartSLOduration=4.663140372 podStartE2EDuration="4.663140372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:34.644391971 +0000 UTC m=+4.646873541" watchObservedRunningTime="2026-09-06 01:09:35.663140372 +0000 UTC m=+5.665621939"
Sep 06 01:09:36.124504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:36.124467    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:36.124695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:36.124553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:36.124695 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.124692    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:36.124797 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.124752    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.124732431 +0000 UTC m=+10.127213991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:36.124900 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.124824    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:36.124900 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.124860    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.124848204 +0000 UTC m=+10.127329753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:36.226301 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:36.225669    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:36.226301 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.225850    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:36.226301 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.225871    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:36.226301 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.225884    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:36.226301 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.225940    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.225921613 +0000 UTC m=+10.228403161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:36.470824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:36.470672    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:36.470824 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.470812    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:36.471425 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:36.471252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:36.471425 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:36.471370    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:37.471568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:37.471061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:37.471568 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:37.471209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:38.474051 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:38.473388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:38.474051 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:38.473520    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:38.474051 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:38.473903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:38.474051 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:38.473989    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:39.471983 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:39.471470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:39.471983 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:39.471623    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:40.155850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:40.155948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.155990    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.156060    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:48.156043741 +0000 UTC m=+18.158525308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.156064    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:40.156128 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.156105    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:09:48.156094085 +0000 UTC m=+18.158575628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:40.257404 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:40.257288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:40.257546 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.257481    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:40.257546 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.257505    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:40.257639 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.257624    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:40.257703 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.257684    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:48.257667551 +0000 UTC m=+18.260149095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:40.473375 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:40.473295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:40.474354 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.474316    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:40.474480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:40.474411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:40.474536 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:40.474507    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:41.471324 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:41.471282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:41.471800 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:41.471424    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:42.471943 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:42.471605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:42.471943 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:42.471743    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:42.471943 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:42.471790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:42.471943 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:42.471913    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:43.471592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:43.471558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:43.471756 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:43.471696    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:44.470999 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:44.470916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:44.471435 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:44.470916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:44.471435 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:44.471070    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:44.471435 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:44.471129    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:45.470834 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:45.470801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:45.471003 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:45.470933    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:46.471329 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:46.471292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:46.471749 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:46.471292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:46.471749 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:46.471451    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:46.471749 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:46.471496    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:47.471367 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:47.471335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:47.471789 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:47.471437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:48.218661 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:48.218618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:48.218843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:48.218678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:48.218843 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.218770    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:48.218843 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.218770    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:48.218843 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.218836    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:10:04.218818017 +0000 UTC m=+34.221299560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:48.219013 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.218853    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:04.218844438 +0000 UTC m=+34.221325982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:48.319491 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:48.319456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:48.319657 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.319622    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:48.319657 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.319646    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:48.319657 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.319656    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:48.319827 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.319717    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:04.31970241 +0000 UTC m=+34.322183954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:48.471113 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:48.471036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:48.471297 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.471158    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:48.471297 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:48.471215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:48.471417 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:48.471341    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:49.471391 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:49.471355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:49.471556 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:49.471487    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:50.472409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:50.472377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:50.474460 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:50.474419    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:50.474579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:50.474477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:50.474625 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:50.474585    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:51.471609 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:51.471574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:51.471729 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:51.471707    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:52.471325 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.471118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:52.472172 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.471126    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:52.472172 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:52.471408    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:52.472172 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:52.471536    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:52.680600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.680566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b878j" event={"ID":"ec82469a-1c83-488e-a8e9-6b52fda99171","Type":"ContainerStarted","Data":"50dbcfaba52032ba684883f5e49e7cc1d434f839ed4f60406ee6367cca6384bf"}
Sep 06 01:09:52.681932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.681909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pwtlg" event={"ID":"95f55eea-24f9-4bec-b10b-ee2dc119ba9c","Type":"ContainerStarted","Data":"fca0f314830ebfb2b7fcbe0652a09039c6814bc2d0fa599084bffe7326fcacb0"}
Sep 06 01:09:52.683328 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.683307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtcnk" event={"ID":"8bece91b-4b27-4ecc-8354-480f069ddde3","Type":"ContainerStarted","Data":"b6e3a654796182131e7fe37bf23b66e096d33759191080392c1b017164589419"}
Sep 06 01:09:52.684868 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.684848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4l89g" event={"ID":"c295b51f-eedb-40f8-b427-4d940dffc043","Type":"ContainerStarted","Data":"c64efc4358607bf604e9a372cb9204db1aab62e534c1f61a6adde4449abc6be3"}
Sep 06 01:09:52.686278 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.686259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr" event={"ID":"9604cca2-33e5-49c6-b3e3-842ec8a1b125","Type":"ContainerStarted","Data":"8f941b57a9fe07ae918399084a191fdbed07d15eadf477e04f60bfe7ce59e9a6"}
Sep 06 01:09:52.687602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.687583    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="cb050ed290d773c5dabcff831c9b11a6e441121c294031d63489eca96d055667" exitCode=0
Sep 06 01:09:52.687686 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.687644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"cb050ed290d773c5dabcff831c9b11a6e441121c294031d63489eca96d055667"}
Sep 06 01:09:52.689029 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.689013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4w6lh" event={"ID":"3abc434c-0079-4166-b374-2e2093fc4b8f","Type":"ContainerStarted","Data":"40995818a31c2134f060894a70d70c2aaca96918a07fbf2eb02bc606a7f3ed31"}
Sep 06 01:09:52.691757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.691739    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:09:52.692088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692071    2582 generic.go:356] "Generic (PLEG): container finished" podID="f9b7fd35-4f46-4f4e-b217-84a964bad302" containerID="ada5a339d267a2d725add9f22efe95effc02a2986eb7729d4eb3ae4aecd97c32" exitCode=1
Sep 06 01:09:52.692149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"b9f186c094f22c69955be7a9fc02622b2870f27b9f3df50039bae0748ba3eda5"}
Sep 06 01:09:52.692149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"ac992c1a118f6427669af764990ff430761ece7400d35912ea61f81a8d03c548"}
Sep 06 01:09:52.692250 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"57897da8757c5d8c3fb12507d3dc640ecd2a4c18284753ab709dc5b71022e789"}
Sep 06 01:09:52.692250 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"a924db29508266ddbe681f27d38f08909b58ea37884240bb441c1c1bfaa2ae38"}
Sep 06 01:09:52.692250 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerDied","Data":"ada5a339d267a2d725add9f22efe95effc02a2986eb7729d4eb3ae4aecd97c32"}
Sep 06 01:09:52.692335 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.692269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"94136e599179805051ba4f4dd170a81c8e8b93d5cce983f241f52ead45c361bf"}
Sep 06 01:09:52.696834 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.696799    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-205.ec2.internal" podStartSLOduration=21.696787518 podStartE2EDuration="21.696787518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:35.663457515 +0000 UTC m=+5.665939093" watchObservedRunningTime="2026-09-06 01:09:52.696787518 +0000 UTC m=+22.699269084"
Sep 06 01:09:52.697140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.697121    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b878j" podStartSLOduration=4.860597366 podStartE2EDuration="22.697113527s" totalImagesPullingTime="17.836516161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:52.696706413 +0000 UTC m=+22.699187980" watchObservedRunningTime="2026-09-06 01:09:52.697113527 +0000 UTC m=+22.699595093"
Sep 06 01:09:52.711711 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.711652    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4l89g" podStartSLOduration=4.845771479 podStartE2EDuration="22.711639537s" totalImagesPullingTime="17.865868058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:52.7110751 +0000 UTC m=+22.713556667" watchObservedRunningTime="2026-09-06 01:09:52.711639537 +0000 UTC m=+22.714121104"
Sep 06 01:09:52.725396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.725361    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4w6lh" podStartSLOduration=7.991735781 podStartE2EDuration="21.725351198s" totalImagesPullingTime="13.733615417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:52.725163333 +0000 UTC m=+22.727644899" watchObservedRunningTime="2026-09-06 01:09:52.725351198 +0000 UTC m=+22.727832764"
Sep 06 01:09:52.766107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.766070    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gtcnk" podStartSLOduration=4.887681738 podStartE2EDuration="22.766058783s" totalImagesPullingTime="17.878377045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:52.765909796 +0000 UTC m=+22.768391362" watchObservedRunningTime="2026-09-06 01:09:52.766058783 +0000 UTC m=+22.768540349"
Sep 06 01:09:52.783011 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:52.782977    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pwtlg" podStartSLOduration=4.855093387 podStartE2EDuration="22.782967511s" totalImagesPullingTime="17.927874124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:52.782663106 +0000 UTC m=+22.785144675" watchObservedRunningTime="2026-09-06 01:09:52.782967511 +0000 UTC m=+22.785449077"
Sep 06 01:09:53.003443 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.003213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:53.054745 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.054723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:53.055389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.055372    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:53.196421 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.196400    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 01:09:53.197940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.197895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:53.442365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.442267    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T01:09:53.196416559Z","UUID":"b20e8ee7-b0dc-4a85-9e4e-b6280492f375","Handler":null,"Name":"","Endpoint":""}
Sep 06 01:09:53.443883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.443859    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 01:09:53.444033 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.443892    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 01:09:53.471037 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.471011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:53.471202 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:53.471129    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:53.598705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.598663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:53.653991 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.653957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:53.696483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.696406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr" event={"ID":"9604cca2-33e5-49c6-b3e3-842ec8a1b125","Type":"ContainerStarted","Data":"46be16b282c794a9b543a3b9948728b5a4e246e48340cdd6dd376db53149635d"}
Sep 06 01:09:53.698162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.698103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pkqv5" event={"ID":"be6ef7e8-c8d0-41b3-b2ce-64768521d9cc","Type":"ContainerStarted","Data":"3ee46d93d68dbcacd1aa30c2553bd4114de5021366d155866c4d2d0ea32d0f07"}
Sep 06 01:09:53.699094 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.699072    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:53.699224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.699149    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4w6lh"
Sep 06 01:09:53.716586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:53.716540    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pkqv5" podStartSLOduration=4.8706265250000005 podStartE2EDuration="22.716529338s" totalImagesPullingTime="17.845902813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:53.716481622 +0000 UTC m=+23.718963191" watchObservedRunningTime="2026-09-06 01:09:53.716529338 +0000 UTC m=+23.719010903"
Sep 06 01:09:54.199879 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.199843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:54.472270 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.471575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:54.472270 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.471605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:54.472270 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:54.471697    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:54.472270 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:54.471797    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:54.602260 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.602235    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:54.704146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.704112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr" event={"ID":"9604cca2-33e5-49c6-b3e3-842ec8a1b125","Type":"ContainerStarted","Data":"dda3f3116c3fa16eb70e0b4ef7a674f5168f43ce6d02fefd45fed8d4169a571b"}
Sep 06 01:09:54.704345 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.704319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:54.707904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.707886    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:09:54.708371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.708348    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"3b672ec05dae37d0ed58acb250ac5bfa0975858a7adee71d6a3b7d0bde041bd9"}
Sep 06 01:09:54.725435 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:54.725324    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l2nhr" podStartSLOduration=3.689231404 podStartE2EDuration="23.725306822s" totalImagesPullingTime="20.036075418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:54.724948838 +0000 UTC m=+24.727430406" watchObservedRunningTime="2026-09-06 01:09:54.725306822 +0000 UTC m=+24.727788391"
Sep 06 01:09:55.003642 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.003555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:55.059731 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.059698    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:55.397961 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.397930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:55.471430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.471397    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:55.471594 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:55.471510    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:55.601666 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.601632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:55.797544 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:55.797472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:56.470896 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:56.470859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:56.471077 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:56.470907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:56.471077 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:56.470997    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:56.471211 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:56.471157    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:56.800496 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:56.800413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.194488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.194458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.296082 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.295903    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.399577 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.399543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.471533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.471510    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:57.471673 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:57.471650    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:57.499931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.499901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.602963 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.602938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:57.717787 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.717714    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:09:57.718086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.718059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"08635e610c1c158a693c3d98efa6763ec5d348f108a5733867807c5e3bf65aba"}
Sep 06 01:09:57.718373 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.718344    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:57.718481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.718413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:57.718545 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.718532    2582 scope.go:117] "RemoveContainer" containerID="ada5a339d267a2d725add9f22efe95effc02a2986eb7729d4eb3ae4aecd97c32"
Sep 06 01:09:57.720087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.720060    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="821a0686b78c0f988635965a41bd6d66842f9073f4e80ec4e39d0ae9c512a4e8" exitCode=0
Sep 06 01:09:57.720161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.720099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"821a0686b78c0f988635965a41bd6d66842f9073f4e80ec4e39d0ae9c512a4e8"}
Sep 06 01:09:57.735362 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.735339    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:57.812483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:57.812453    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:58.474519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.474499    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:09:58.474615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.474505    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:09:58.474615 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:58.474601    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:09:58.474731 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:58.474676    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:09:58.603217 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.603166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:58.708940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.708866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:58.724530 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.724504    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="86a943df64f3e737aa089bc3e6577e526245e270e34948da07e97059e0fd08f4" exitCode=0
Sep 06 01:09:58.724655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.724589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"86a943df64f3e737aa089bc3e6577e526245e270e34948da07e97059e0fd08f4"}
Sep 06 01:09:58.728589 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.728561    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:09:58.728937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.728917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" event={"ID":"f9b7fd35-4f46-4f4e-b217-84a964bad302","Type":"ContainerStarted","Data":"a8985be4f6be4a2f3344ad07b33064437c105396e6acf3955868738995440b59"}
Sep 06 01:09:58.729109 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.729094    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:58.744171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.744150    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:09:58.777578 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:58.777538    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq" podStartSLOduration=10.897083452 podStartE2EDuration="28.777527214s" totalImagesPullingTime="17.880443762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:58.777385192 +0000 UTC m=+28.779866757" watchObservedRunningTime="2026-09-06 01:09:58.777527214 +0000 UTC m=+28.780008780"
Sep 06 01:09:59.198064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.198036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.299406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.299337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.400425 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.400403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.470521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.470493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.470604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.470529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:09:59.470639 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:09:59.470609    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:09:59.589417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.589348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.690727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.690699    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:59.733730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.733702    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="52555719d1bbe72e2d5d0a976a9ceac98005d8e548a9790d90a6f516def81eaa" exitCode=0
Sep 06 01:09:59.733829 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.733749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"52555719d1bbe72e2d5d0a976a9ceac98005d8e548a9790d90a6f516def81eaa"}
Sep 06 01:09:59.965331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:09:59.965304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.020009 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.019979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.368166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.368080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.430150 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.430119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.471433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.471402    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:00.471596 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.471486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:00.471596 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:00.471502    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:00.471704 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:00.471600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:00.594795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.594757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.692189 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.692158    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:00.975128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:00.975023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:01.076451 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.076419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:01.176900 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.176867    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:01.277058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.276979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:01.399081 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.399044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:01.470764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.470735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:01.470919 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:01.470848    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:01.801391 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:01.801357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:02.441554 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:02.441373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:02.471544 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:02.471502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:02.471691 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:02.471502    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:02.471691 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:02.471651    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:02.471823 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:02.471695    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:02.561091 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:02.561051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:03.470778 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:03.470744    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:03.471352 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:03.470884    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:04.234318 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.234277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:04.234505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.234369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:04.234505 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.234440    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:10:04.234505 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.234457    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:10:04.234505 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.234497    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret podName:c731e94b-ea94-46f5-975a-7a356865f7db nodeName:}" failed. No retries permitted until 2026-09-06 01:10:36.234481422 +0000 UTC m=+66.236962979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret") pod "global-pull-secret-syncer-n97kl" (UID: "c731e94b-ea94-46f5-975a-7a356865f7db") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:10:04.234727 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.234516    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs podName:ce7ebc37-0238-41aa-a1d0-911f61a0ecb1 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:36.23450583 +0000 UTC m=+66.236987374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs") pod "network-metrics-daemon-8nxgv" (UID: "ce7ebc37-0238-41aa-a1d0-911f61a0ecb1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:10:04.335647 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.335605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:04.335812 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.335772    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:10:04.335812 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.335796    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:10:04.335812 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.335810    2582 projected.go:196] Error preparing data for projected volume kube-api-access-xj5t5 for pod openshift-network-diagnostics/network-check-target-jfdkq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:10:04.335948 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.335867    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5 podName:ba68e4a3-0a93-4bb4-b999-f169bca4f4e0 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:36.335849181 +0000 UTC m=+66.338330724 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xj5t5" (UniqueName: "kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5") pod "network-check-target-jfdkq" (UID: "ba68e4a3-0a93-4bb4-b999-f169bca4f4e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:10:04.470904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.470865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:04.471295 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.470976    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:04.471295 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.471006    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:04.471295 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:04.471071    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:04.747102 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.747069    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="70015e06374ac807f40c5287ecdf46add1653a0db9198bb3dfa2c8e2977a9fb7" exitCode=0
Sep 06 01:10:04.747233 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:04.747116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"70015e06374ac807f40c5287ecdf46add1653a0db9198bb3dfa2c8e2977a9fb7"}
Sep 06 01:10:05.124076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.124049    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:05.225972 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.225937    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:05.318948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.318919    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:05.419071 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.419001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:05.471161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.471135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:05.471506 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:05.471245    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:05.519199 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.519149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:05.752901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.752830    2582 generic.go:356] "Generic (PLEG): container finished" podID="32bf690a-fb1a-476b-ac49-fa259b79d885" containerID="ad3958ff37d506f01211b80e839440ac4c85596c509fbe8afb7361143872366e" exitCode=0
Sep 06 01:10:05.752901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:05.752881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerDied","Data":"ad3958ff37d506f01211b80e839440ac4c85596c509fbe8afb7361143872366e"}
Sep 06 01:10:06.228423 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.228394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n97kl"]
Sep 06 01:10:06.228588 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.228503    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:06.229228 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:06.228614    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:06.230994 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.230974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nxgv"]
Sep 06 01:10:06.231082 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.231072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:06.231198 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:06.231164    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:06.241412 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.241390    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfdkq"]
Sep 06 01:10:06.241598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.241584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:06.241762 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:06.241742    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:06.505655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.505625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:06.564975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.564930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:06.759526 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.759461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-84fq4" event={"ID":"32bf690a-fb1a-476b-ac49-fa259b79d885","Type":"ContainerStarted","Data":"36b9755a7a4f95312a3ce202eab4e54dcf45db678dca8f73e40a46a241858261"}
Sep 06 01:10:06.784574 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:06.784528    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-84fq4" podStartSLOduration=8.305118447 podStartE2EDuration="36.784512795s" totalImagesPullingTime="28.479394348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:06.784013866 +0000 UTC m=+36.786495432" watchObservedRunningTime="2026-09-06 01:10:06.784512795 +0000 UTC m=+36.786994360"
Sep 06 01:10:07.307776 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:07.307745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:07.407468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:07.407437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:07.700138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:07.700106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:07.753273 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:07.753101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:08.471325 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:08.471296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:08.471488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:08.471300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:08.471488 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:08.471403    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:08.471488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:08.471411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:08.471603 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:08.471488    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:08.471603 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:08.471547    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:08.514115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:08.514091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:08.907775 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:08.907745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:09.007908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:09.007878    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:10.040997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.040967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:10.093206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.093161    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:10.473780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.473752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:10.473927 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.473803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:10.473966 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:10.473924    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jfdkq" podUID="ba68e4a3-0a93-4bb4-b999-f169bca4f4e0"
Sep 06 01:10:10.473966 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:10.473951    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n97kl" podUID="c731e94b-ea94-46f5-975a-7a356865f7db"
Sep 06 01:10:10.474043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.474010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:10.474120 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:10.474101    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nxgv" podUID="ce7ebc37-0238-41aa-a1d0-911f61a0ecb1"
Sep 06 01:10:10.810120 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.810094    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-205.ec2.internal" event="NodeReady"
Sep 06 01:10:10.810290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.810265    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 01:10:10.856728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.856698    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kzfxt"]
Sep 06 01:10:10.884365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.884339    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zk8jl"]
Sep 06 01:10:10.884483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.884344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:10.887077 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.887057    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjq89\""
Sep 06 01:10:10.887171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.887065    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 01:10:10.887238 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.887211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 01:10:10.904090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.904073    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzfxt"]
Sep 06 01:10:10.904209 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.904103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zk8jl"]
Sep 06 01:10:10.904257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.904208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:10.906770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.906753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g5vzv\""
Sep 06 01:10:10.906770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.906761    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 01:10:10.906917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.906791    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 01:10:10.907039 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.907027    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 01:10:10.967242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.967215    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9kvmk"]
Sep 06 01:10:10.973722 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.973703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:10.986078 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.986057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9kvmk"]
Sep 06 01:10:10.986195 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.986166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:10.989034 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.989017    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5j6d7\""
Sep 06 01:10:10.989137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.989055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 01:10:10.989137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.989098    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 01:10:10.989290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.989140    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 01:10:10.989290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.989099    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 01:10:10.993640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kl5\" (UniqueName: \"kubernetes.io/projected/c56f943e-4335-4d1a-a1b0-a55f26170fad-kube-api-access-s7kl5\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:10.993723 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffa66ac2-e7d7-418c-a600-87d2edd354cc-metrics-tls\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:10.993723 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56f943e-4335-4d1a-a1b0-a55f26170fad-cert\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:10.993802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa66ac2-e7d7-418c-a600-87d2edd354cc-tmp-dir\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:10.993802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffa66ac2-e7d7-418c-a600-87d2edd354cc-config-volume\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:10.993870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:10.993810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92fh\" (UniqueName: \"kubernetes.io/projected/ffa66ac2-e7d7-418c-a600-87d2edd354cc-kube-api-access-z92fh\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.094929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffa66ac2-e7d7-418c-a600-87d2edd354cc-config-volume\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.094929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92fh\" (UniqueName: \"kubernetes.io/projected/ffa66ac2-e7d7-418c-a600-87d2edd354cc-kube-api-access-z92fh\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.094929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kl5\" (UniqueName: \"kubernetes.io/projected/c56f943e-4335-4d1a-a1b0-a55f26170fad-kube-api-access-s7kl5\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:11.094929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffa66ac2-e7d7-418c-a600-87d2edd354cc-metrics-tls\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56f943e-4335-4d1a-a1b0-a55f26170fad-cert\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.094994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35317b55-e8a3-46fb-a822-d460b35fb8a3-crio-socket\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35317b55-e8a3-46fb-a822-d460b35fb8a3-data-volume\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa66ac2-e7d7-418c-a600-87d2edd354cc-tmp-dir\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35317b55-e8a3-46fb-a822-d460b35fb8a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzhqk\" (UniqueName: \"kubernetes.io/projected/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-api-access-lzhqk\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffa66ac2-e7d7-418c-a600-87d2edd354cc-tmp-dir\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.095557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.095531    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ffa66ac2-e7d7-418c-a600-87d2edd354cc-config-volume\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.099007 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.098976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ffa66ac2-e7d7-418c-a600-87d2edd354cc-metrics-tls\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.099007 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.099001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c56f943e-4335-4d1a-a1b0-a55f26170fad-cert\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:11.105092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.105067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92fh\" (UniqueName: \"kubernetes.io/projected/ffa66ac2-e7d7-418c-a600-87d2edd354cc-kube-api-access-z92fh\") pod \"dns-default-kzfxt\" (UID: \"ffa66ac2-e7d7-418c-a600-87d2edd354cc\") " pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.105199 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.105120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kl5\" (UniqueName: \"kubernetes.io/projected/c56f943e-4335-4d1a-a1b0-a55f26170fad-kube-api-access-s7kl5\") pod \"ingress-canary-zk8jl\" (UID: \"c56f943e-4335-4d1a-a1b0-a55f26170fad\") " pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:11.193235 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.193175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:11.196426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.196404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.196478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.196448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35317b55-e8a3-46fb-a822-d460b35fb8a3-crio-socket\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.196478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.196465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35317b55-e8a3-46fb-a822-d460b35fb8a3-data-volume\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.196534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.196487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35317b55-e8a3-46fb-a822-d460b35fb8a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.196534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.196527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzhqk\" (UniqueName: \"kubernetes.io/projected/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-api-access-lzhqk\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.197132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.197082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/35317b55-e8a3-46fb-a822-d460b35fb8a3-crio-socket\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.197261 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.197219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/35317b55-e8a3-46fb-a822-d460b35fb8a3-data-volume\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.197687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.197665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.200064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.200035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/35317b55-e8a3-46fb-a822-d460b35fb8a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.205627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.205608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzhqk\" (UniqueName: \"kubernetes.io/projected/35317b55-e8a3-46fb-a822-d460b35fb8a3-kube-api-access-lzhqk\") pod \"insights-runtime-extractor-9kvmk\" (UID: \"35317b55-e8a3-46fb-a822-d460b35fb8a3\") " pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.211479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.211464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zk8jl"
Sep 06 01:10:11.295416 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.294840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9kvmk"
Sep 06 01:10:11.520969 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.520937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zk8jl"]
Sep 06 01:10:11.524338 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.524311    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kzfxt"]
Sep 06 01:10:11.524452 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:11.524397    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56f943e_4335_4d1a_a1b0_a55f26170fad.slice/crio-752affd7bbbe70903947d0d148bffaea1bce3553684f830cdb33d683be70b11b WatchSource:0}: Error finding container 752affd7bbbe70903947d0d148bffaea1bce3553684f830cdb33d683be70b11b: Status 404 returned error can't find the container with id 752affd7bbbe70903947d0d148bffaea1bce3553684f830cdb33d683be70b11b
Sep 06 01:10:11.526702 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:11.526680    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa66ac2_e7d7_418c_a600_87d2edd354cc.slice/crio-aca7422911bdad0fd82781759c8b5b7e2b31b80c00be9ce80d91126bc84df7e8 WatchSource:0}: Error finding container aca7422911bdad0fd82781759c8b5b7e2b31b80c00be9ce80d91126bc84df7e8: Status 404 returned error can't find the container with id aca7422911bdad0fd82781759c8b5b7e2b31b80c00be9ce80d91126bc84df7e8
Sep 06 01:10:11.592933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.592905    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9kvmk"]
Sep 06 01:10:11.596567 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:11.596535    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35317b55_e8a3_46fb_a822_d460b35fb8a3.slice/crio-f9d1c4dc7965ba66ca06296c6ea61b94cc2e983bf0b99c9122c0ee6704cdad09 WatchSource:0}: Error finding container f9d1c4dc7965ba66ca06296c6ea61b94cc2e983bf0b99c9122c0ee6704cdad09: Status 404 returned error can't find the container with id f9d1c4dc7965ba66ca06296c6ea61b94cc2e983bf0b99c9122c0ee6704cdad09
Sep 06 01:10:11.646329 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.646308    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:11.674383 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.674354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:11.674470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.674449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.677397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.677375    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 06 01:10:11.677535 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.677438    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 06 01:10:11.678509 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678490    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ndj9t\""
Sep 06 01:10:11.678636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678507    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 06 01:10:11.678636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678488    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 06 01:10:11.678848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678827    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 06 01:10:11.678934 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678852    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 06 01:10:11.678934 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.678859    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 06 01:10:11.688340 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.688321    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:11.762107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.762082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:11.771704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.771681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kvmk" event={"ID":"35317b55-e8a3-46fb-a822-d460b35fb8a3","Type":"ContainerStarted","Data":"48f344e26026159a6eb0758ef62196aaa12e036ab41618a15b215b186a47e140"}
Sep 06 01:10:11.771795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.771737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kvmk" event={"ID":"35317b55-e8a3-46fb-a822-d460b35fb8a3","Type":"ContainerStarted","Data":"f9d1c4dc7965ba66ca06296c6ea61b94cc2e983bf0b99c9122c0ee6704cdad09"}
Sep 06 01:10:11.772793 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.772768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zk8jl" event={"ID":"c56f943e-4335-4d1a-a1b0-a55f26170fad","Type":"ContainerStarted","Data":"752affd7bbbe70903947d0d148bffaea1bce3553684f830cdb33d683be70b11b"}
Sep 06 01:10:11.773801 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.773780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzfxt" event={"ID":"ffa66ac2-e7d7-418c-a600-87d2edd354cc","Type":"ContainerStarted","Data":"aca7422911bdad0fd82781759c8b5b7e2b31b80c00be9ce80d91126bc84df7e8"}
Sep 06 01:10:11.802102 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.802200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802118    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.802200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.802284 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wbj\" (UniqueName: \"kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.802284 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.802356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.802286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.851964 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.851931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:11.857699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.857674    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"]
Sep 06 01:10:11.880568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.880495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"]
Sep 06 01:10:11.880680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.880606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:11.883289 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.883270    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 06 01:10:11.883388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.883309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6bjqb\""
Sep 06 01:10:11.903157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903269 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903269 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903310    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wbj\" (UniqueName: \"kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903872 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903852    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.903959 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.903882    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.904167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.904146    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.905562 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.905546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.905608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.905586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.911503 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.911467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wbj\" (UniqueName: \"kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj\") pod \"console-5d896d548d-59q5c\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") " pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:11.983504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:11.983479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:12.005541 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.005521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cnqm4\" (UID: \"04c4daa8-850e-4907-bd0b-6514152a92c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:12.106878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.106848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cnqm4\" (UID: \"04c4daa8-850e-4907-bd0b-6514152a92c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:12.107265 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:12.107017    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 06 01:10:12.107265 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:12.107089    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates podName:04c4daa8-850e-4907-bd0b-6514152a92c4 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:12.60706994 +0000 UTC m=+42.609551483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-cnqm4" (UID: "04c4daa8-850e-4907-bd0b-6514152a92c4") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 06 01:10:12.273597 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.273521    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:12.277457 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:12.277433    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f87a851_c41e_42f5_a706_54f4807c9046.slice/crio-36ff252edc1a03d22df323f863eaeca1a469c48756584b69f09ef754f40b8a05 WatchSource:0}: Error finding container 36ff252edc1a03d22df323f863eaeca1a469c48756584b69f09ef754f40b8a05: Status 404 returned error can't find the container with id 36ff252edc1a03d22df323f863eaeca1a469c48756584b69f09ef754f40b8a05
Sep 06 01:10:12.291537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.291510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:12.475327 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.475299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:12.475488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.475298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:12.475488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.475298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:12.479048 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.478987    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 01:10:12.481537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.480205    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 01:10:12.481537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.480404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:10:12.481537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.480566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:10:12.481537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.480713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:10:12.481537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.480880    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:10:12.610625 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.610539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cnqm4\" (UID: \"04c4daa8-850e-4907-bd0b-6514152a92c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:12.613563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.613533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/04c4daa8-850e-4907-bd0b-6514152a92c4-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-cnqm4\" (UID: \"04c4daa8-850e-4907-bd0b-6514152a92c4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:12.779146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.779111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d896d548d-59q5c" event={"ID":"1f87a851-c41e-42f5-a706-54f4807c9046","Type":"ContainerStarted","Data":"36ff252edc1a03d22df323f863eaeca1a469c48756584b69f09ef754f40b8a05"}
Sep 06 01:10:12.789327 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:12.789300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:14.997933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:14.997893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:15.046830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:15.046788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:15.658110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:15.658077    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:15.718617 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:15.718592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:16.490170 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.490137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"]
Sep 06 01:10:16.494586 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:16.494556    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c4daa8_850e_4907_bd0b_6514152a92c4.slice/crio-ad72047e3b95e7e83fa7feade7423e8d0dff8cab756808e87584af434afa0462 WatchSource:0}: Error finding container ad72047e3b95e7e83fa7feade7423e8d0dff8cab756808e87584af434afa0462: Status 404 returned error can't find the container with id ad72047e3b95e7e83fa7feade7423e8d0dff8cab756808e87584af434afa0462
Sep 06 01:10:16.593729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.593700    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:16.793220 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.793122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzfxt" event={"ID":"ffa66ac2-e7d7-418c-a600-87d2edd354cc","Type":"ContainerStarted","Data":"e090122b24436b49c63e844e568134b9293aac1fb255207c2f5757600af20b92"}
Sep 06 01:10:16.793220 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.793172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kzfxt" event={"ID":"ffa66ac2-e7d7-418c-a600-87d2edd354cc","Type":"ContainerStarted","Data":"bdbea6af6df57a0e3985ad989e41a15ae02de4b7e39c1dd0553fef5287e6c895"}
Sep 06 01:10:16.793445 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.793247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:16.794802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.794774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d896d548d-59q5c" event={"ID":"1f87a851-c41e-42f5-a706-54f4807c9046","Type":"ContainerStarted","Data":"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"}
Sep 06 01:10:16.796394 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.796374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kvmk" event={"ID":"35317b55-e8a3-46fb-a822-d460b35fb8a3","Type":"ContainerStarted","Data":"6ad143ddae68a1696403c136a61e2c94a6bc99307747d84471f010cbea8fcf75"}
Sep 06 01:10:16.797431 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.797412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4" event={"ID":"04c4daa8-850e-4907-bd0b-6514152a92c4","Type":"ContainerStarted","Data":"ad72047e3b95e7e83fa7feade7423e8d0dff8cab756808e87584af434afa0462"}
Sep 06 01:10:16.798876 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.798858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zk8jl" event={"ID":"c56f943e-4335-4d1a-a1b0-a55f26170fad","Type":"ContainerStarted","Data":"1188864c331bfc9aaeb7757a095281a8314d4c2d665605dfbbb410c595cc7fdc"}
Sep 06 01:10:16.811101 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.811047    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kzfxt" podStartSLOduration=2.120619317 podStartE2EDuration="6.811030937s" totalImagesPullingTime="4.69041162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:16.810854294 +0000 UTC m=+46.813335891" watchObservedRunningTime="2026-09-06 01:10:16.811030937 +0000 UTC m=+46.813512514"
Sep 06 01:10:16.825058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.825017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zk8jl" podStartSLOduration=2.130849387 podStartE2EDuration="6.825004131s" totalImagesPullingTime="4.694154744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:16.824217448 +0000 UTC m=+46.826699015" watchObservedRunningTime="2026-09-06 01:10:16.825004131 +0000 UTC m=+46.827485752"
Sep 06 01:10:16.839766 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:16.839728    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d896d548d-59q5c" podStartSLOduration=1.891553407 podStartE2EDuration="5.839717812s" totalImagesPullingTime="3.948164405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:16.839318275 +0000 UTC m=+46.841799869" watchObservedRunningTime="2026-09-06 01:10:16.839717812 +0000 UTC m=+46.842199378"
Sep 06 01:10:18.384290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.384257    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:10:18.405420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.405396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.405560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.405403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:10:18.413775 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.413757    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 06 01:10:18.459635 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459735 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459735 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459807 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459736    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459807 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntpsf\" (UniqueName: \"kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.459875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.459828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntpsf\" (UniqueName: \"kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560424    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.560547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.560526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.561118 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.561090    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.561118 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.561112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.561470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.561364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.561470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.561463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.563063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.563033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.563172 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.563120    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.568771 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.568750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntpsf\" (UniqueName: \"kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf\") pod \"console-77db7755f6-mlftp\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") " pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.574384 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.574366    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:18.681661 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.681629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:18.714106 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.714079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:18.734431 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.734405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:18.811027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.810996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9kvmk" event={"ID":"35317b55-e8a3-46fb-a822-d460b35fb8a3","Type":"ContainerStarted","Data":"c34136325e07e2292c147e847ed9b1268d1c430dce9e458421cceea1a417a97e"}
Sep 06 01:10:18.812665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.812643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4" event={"ID":"04c4daa8-850e-4907-bd0b-6514152a92c4","Type":"ContainerStarted","Data":"f64de138ba972fb56ccbb8c46ce337b8910a7faf18b8a25eafe88e9dc72b4ca2"}
Sep 06 01:10:18.812845 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.812831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:18.817376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.817358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4"
Sep 06 01:10:18.828848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.828812    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9kvmk" podStartSLOduration=2.107736502 podStartE2EDuration="8.828799551s" totalImagesPullingTime="6.721063049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:10:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:18.828469801 +0000 UTC m=+48.830951380" watchObservedRunningTime="2026-09-06 01:10:18.828799551 +0000 UTC m=+48.831281155"
Sep 06 01:10:18.842988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:18.842946    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-cnqm4" podStartSLOduration=5.698448181 podStartE2EDuration="7.842931045s" totalImagesPullingTime="2.144482864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:18.842348009 +0000 UTC m=+48.844829575" watchObservedRunningTime="2026-09-06 01:10:18.842931045 +0000 UTC m=+48.845412611"
Sep 06 01:10:19.016846 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.016760    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:10:19.019541 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:19.019518    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b25fc25_917d_45df_a6f9_986f7028d0c8.slice/crio-06a8ed1ff453a2ca10a1cd0cdab3bf9da4ca6b98e13f6a10add043c71125b683 WatchSource:0}: Error finding container 06a8ed1ff453a2ca10a1cd0cdab3bf9da4ca6b98e13f6a10add043c71125b683: Status 404 returned error can't find the container with id 06a8ed1ff453a2ca10a1cd0cdab3bf9da4ca6b98e13f6a10add043c71125b683
Sep 06 01:10:19.816704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.816667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77db7755f6-mlftp" event={"ID":"8b25fc25-917d-45df-a6f9-986f7028d0c8","Type":"ContainerStarted","Data":"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"}
Sep 06 01:10:19.817142 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.816739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77db7755f6-mlftp" event={"ID":"8b25fc25-917d-45df-a6f9-986f7028d0c8","Type":"ContainerStarted","Data":"06a8ed1ff453a2ca10a1cd0cdab3bf9da4ca6b98e13f6a10add043c71125b683"}
Sep 06 01:10:19.837702 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.837657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77db7755f6-mlftp" podStartSLOduration=1.837644217 podStartE2EDuration="1.837644217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:19.836980365 +0000 UTC m=+49.839461930" watchObservedRunningTime="2026-09-06 01:10:19.837644217 +0000 UTC m=+49.840125782"
Sep 06 01:10:19.889817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.889780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:19.931248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.931221    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"]
Sep 06 01:10:19.944801 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.944783    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:19.949817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.949794    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 01:10:19.949932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.949832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 06 01:10:19.950032 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.950017    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 06 01:10:19.950103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.950066    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5x6m9\""
Sep 06 01:10:19.950596 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.950580    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 01:10:19.951646 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.951625    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 01:10:19.969173 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.969151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"]
Sep 06 01:10:19.971141 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.971116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:19.971231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.971189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:19.971283 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.971253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxn6r\" (UniqueName: \"kubernetes.io/projected/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-kube-api-access-gxn6r\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:19.971382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.971365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:19.990871 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:19.990845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:20.064765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.064736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:20.071966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.071906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.071966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.071943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxn6r\" (UniqueName: \"kubernetes.io/projected/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-kube-api-access-gxn6r\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.072110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.071991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.072110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.072018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.072546 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.072529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.074689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.074664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.074773 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.074687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.080975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.080956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxn6r\" (UniqueName: \"kubernetes.io/projected/f7e1ebb6-0ac8-446b-b010-c8dcbb017903-kube-api-access-gxn6r\") pod \"prometheus-operator-6f4946db56-fsx4r\" (UID: \"f7e1ebb6-0ac8-446b-b010-c8dcbb017903\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.254128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.254093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"
Sep 06 01:10:20.544684 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.544620    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-fsx4r"]
Sep 06 01:10:20.547063 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:20.547032    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e1ebb6_0ac8_446b_b010_c8dcbb017903.slice/crio-b92da8c397891fef1c8cfd9956086a3f0b072ffaa357771bfdf187eda387c33c WatchSource:0}: Error finding container b92da8c397891fef1c8cfd9956086a3f0b072ffaa357771bfdf187eda387c33c: Status 404 returned error can't find the container with id b92da8c397891fef1c8cfd9956086a3f0b072ffaa357771bfdf187eda387c33c
Sep 06 01:10:20.820417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:20.820376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r" event={"ID":"f7e1ebb6-0ac8-446b-b010-c8dcbb017903","Type":"ContainerStarted","Data":"b92da8c397891fef1c8cfd9956086a3f0b072ffaa357771bfdf187eda387c33c"}
Sep 06 01:10:21.036097 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.036059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:21.088971 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.088908    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:21.958021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.957990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:21.983815 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.983792    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:21.983937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.983908    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:21.988532 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:21.988502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:22.060591 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.060546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:22.525655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.525579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:22.828458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.828363    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r" event={"ID":"f7e1ebb6-0ac8-446b-b010-c8dcbb017903","Type":"ContainerStarted","Data":"362eb69654f568b3ead8a5f46b73c03ee8258c9479684954c217e520cf365ad9"}
Sep 06 01:10:22.828458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.828427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r" event={"ID":"f7e1ebb6-0ac8-446b-b010-c8dcbb017903","Type":"ContainerStarted","Data":"a056401b4068f16e7abc53677711889b388717b61a12aac20294e24aa290a5bd"}
Sep 06 01:10:22.832362 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.832341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:22.846370 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:22.846328    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-fsx4r" podStartSLOduration=2.177157677 podStartE2EDuration="3.846313968s" totalImagesPullingTime="1.669156291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:22.845982619 +0000 UTC m=+52.848464186" watchObservedRunningTime="2026-09-06 01:10:22.846313968 +0000 UTC m=+52.848795533"
Sep 06 01:10:23.002692 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:23.002661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:23.104096 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:23.104011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:23.600317 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:23.600284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:23.657115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:23.657068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.019446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.019395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.227561 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.227522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.282975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.282898    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"]
Sep 06 01:10:24.296035 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.296012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.299053 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.299032    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 06 01:10:24.299053 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.299045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 06 01:10:24.299276 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.299108    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rmk8g\""
Sep 06 01:10:24.304103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.304084    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"]
Sep 06 01:10:24.308561 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.308544    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"]
Sep 06 01:10:24.328619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.328600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.331712 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.331688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hfptq\""
Sep 06 01:10:24.331834 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.331818    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 06 01:10:24.331987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.331972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 06 01:10:24.332422 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.332409    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 06 01:10:24.343052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.343032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.347675 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.347656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"]
Sep 06 01:10:24.366806 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.366782    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f6p9j"]
Sep 06 01:10:24.388464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.388437    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.390791 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.390769    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 01:10:24.391047 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.391028    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 01:10:24.391149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.391057    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qk4l2\""
Sep 06 01:10:24.391149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.391065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 01:10:24.407132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jphrq\" (UniqueName: \"kubernetes.io/projected/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-api-access-jphrq\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-sys\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsnjv\" (UniqueName: \"kubernetes.io/projected/0541adff-c7af-4e9b-811f-4e3367908c79-kube-api-access-wsnjv\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.407231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-root\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fbe95b5-12d9-4712-9254-b27e6fda1be6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.407480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-tls\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-textfile\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.407480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-metrics-client-ca\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0541adff-c7af-4e9b-811f-4e3367908c79-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.407595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-wtmp\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4dds\" (UniqueName: \"kubernetes.io/projected/6577b814-9e03-4121-8b06-6b050e4e138e-kube-api-access-h4dds\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.407730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.407609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.452454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.452428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.508174 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-wtmp\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4dds\" (UniqueName: \"kubernetes.io/projected/6577b814-9e03-4121-8b06-6b050e4e138e-kube-api-access-h4dds\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jphrq\" (UniqueName: \"kubernetes.io/projected/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-api-access-jphrq\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-sys\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsnjv\" (UniqueName: \"kubernetes.io/projected/0541adff-c7af-4e9b-811f-4e3367908c79-kube-api-access-wsnjv\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.508334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508328    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-root\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-wtmp\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fbe95b5-12d9-4712-9254-b27e6fda1be6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:24.508378    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-sys\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:24.508452    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls podName:0541adff-c7af-4e9b-811f-4e3367908c79 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:25.008431061 +0000 UTC m=+55.010912618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-2l8x9" (UID: "0541adff-c7af-4e9b-811f-4e3367908c79") : secret "openshift-state-metrics-tls" not found
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508494    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6577b814-9e03-4121-8b06-6b050e4e138e-root\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-tls\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-textfile\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.508657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-metrics-client-ca\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:24.508723    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0541adff-c7af-4e9b-811f-4e3367908c79-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:24.508771    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls podName:6fbe95b5-12d9-4712-9254-b27e6fda1be6 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:25.008756524 +0000 UTC m=+55.011238070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-xqnbs" (UID: "6fbe95b5-12d9-4712-9254-b27e6fda1be6") : secret "kube-state-metrics-tls" not found
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.508788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6fbe95b5-12d9-4712-9254-b27e6fda1be6-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.509129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-textfile\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.509268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.509353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.509351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.509794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.509527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-accelerators-collector-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.509794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.509748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6577b814-9e03-4121-8b06-6b050e4e138e-metrics-client-ca\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.510213 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.510172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0541adff-c7af-4e9b-811f-4e3367908c79-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.511218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.511201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-tls\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.511507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.511486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.511626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.511611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6577b814-9e03-4121-8b06-6b050e4e138e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.511703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.511687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.519704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.519678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jphrq\" (UniqueName: \"kubernetes.io/projected/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-api-access-jphrq\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:24.519924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.519904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsnjv\" (UniqueName: \"kubernetes.io/projected/0541adff-c7af-4e9b-811f-4e3367908c79-kube-api-access-wsnjv\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:24.520072 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.520055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4dds\" (UniqueName: \"kubernetes.io/projected/6577b814-9e03-4121-8b06-6b050e4e138e-kube-api-access-h4dds\") pod \"node-exporter-f6p9j\" (UID: \"6577b814-9e03-4121-8b06-6b050e4e138e\") " pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.554965 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.554883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.654704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.654669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.697474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.697450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f6p9j"
Sep 06 01:10:24.729880 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:24.729857    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6577b814_9e03_4121_8b06_6b050e4e138e.slice/crio-1997312a39e61c969be7d6a6b868b6a523c77a9b35463f8a13a663726bbedc04 WatchSource:0}: Error finding container 1997312a39e61c969be7d6a6b868b6a523c77a9b35463f8a13a663726bbedc04: Status 404 returned error can't find the container with id 1997312a39e61c969be7d6a6b868b6a523c77a9b35463f8a13a663726bbedc04
Sep 06 01:10:24.751682 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.751658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:24.835113 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.835043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6p9j" event={"ID":"6577b814-9e03-4121-8b06-6b050e4e138e","Type":"ContainerStarted","Data":"1997312a39e61c969be7d6a6b868b6a523c77a9b35463f8a13a663726bbedc04"}
Sep 06 01:10:24.854097 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:24.854073    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:25.014566 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.014531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:25.014566 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.014568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:25.014802 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:25.014659    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 06 01:10:25.014802 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:25.014717    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls podName:6fbe95b5-12d9-4712-9254-b27e6fda1be6 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:26.014703399 +0000 UTC m=+56.017184944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-xqnbs" (UID: "6fbe95b5-12d9-4712-9254-b27e6fda1be6") : secret "kube-state-metrics-tls" not found
Sep 06 01:10:25.017067 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.017043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0541adff-c7af-4e9b-811f-4e3367908c79-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-2l8x9\" (UID: \"0541adff-c7af-4e9b-811f-4e3367908c79\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:25.189468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.189439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:25.204805 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.204775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"
Sep 06 01:10:25.311466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.311431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:25.391705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.391680    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:25.493369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.493342    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9"]
Sep 06 01:10:25.496034 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.496004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:25.647318 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:25.647277    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0541adff_c7af_4e9b_811f_4e3367908c79.slice/crio-3c81172fc4ff774a87f1de3872229d06508fc43127e3bbbad96ac337f6a53e27 WatchSource:0}: Error finding container 3c81172fc4ff774a87f1de3872229d06508fc43127e3bbbad96ac337f6a53e27: Status 404 returned error can't find the container with id 3c81172fc4ff774a87f1de3872229d06508fc43127e3bbbad96ac337f6a53e27
Sep 06 01:10:25.839990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.839950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9" event={"ID":"0541adff-c7af-4e9b-811f-4e3367908c79","Type":"ContainerStarted","Data":"5e2bcf1c33ad0773a7c652c3cfbc921405131185edcaa3277b944ce7fd36f163"}
Sep 06 01:10:25.840132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.840011    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9" event={"ID":"0541adff-c7af-4e9b-811f-4e3367908c79","Type":"ContainerStarted","Data":"14be66b2feb5e23603e2e22a7ce7ad08baa83df874368da4c557e76e41b27a12"}
Sep 06 01:10:25.840132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.840039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9" event={"ID":"0541adff-c7af-4e9b-811f-4e3367908c79","Type":"ContainerStarted","Data":"3c81172fc4ff774a87f1de3872229d06508fc43127e3bbbad96ac337f6a53e27"}
Sep 06 01:10:25.841542 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.841516    2582 generic.go:356] "Generic (PLEG): container finished" podID="6577b814-9e03-4121-8b06-6b050e4e138e" containerID="7f9cf814b2c00fe434ba077d1da955b7942e7afa0e2939c65b4b9db951392932" exitCode=0
Sep 06 01:10:25.841656 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.841576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6p9j" event={"ID":"6577b814-9e03-4121-8b06-6b050e4e138e","Type":"ContainerDied","Data":"7f9cf814b2c00fe434ba077d1da955b7942e7afa0e2939c65b4b9db951392932"}
Sep 06 01:10:25.945682 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:25.945660    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:26.023108 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.023040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:26.025475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.025458    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6fbe95b5-12d9-4712-9254-b27e6fda1be6-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-xqnbs\" (UID: \"6fbe95b5-12d9-4712-9254-b27e6fda1be6\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:26.137194 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.137158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"
Sep 06 01:10:26.299144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.299068    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5655fbb567-rdq4h"]
Sep 06 01:10:26.301847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.301829    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.304450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 06 01:10:26.304603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304582    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 06 01:10:26.304729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 06 01:10:26.304799 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 06 01:10:26.304857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 06 01:10:26.304857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d3vq6t4iv9jie\""
Sep 06 01:10:26.304978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.304826    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-96bzr\""
Sep 06 01:10:26.313740 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.313721    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5655fbb567-rdq4h"]
Sep 06 01:10:26.325528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-grpc-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszgq\" (UniqueName: \"kubernetes.io/projected/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-kube-api-access-nszgq\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325868 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-metrics-client-ca\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.325941 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.325924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.407346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.407315    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs"]
Sep 06 01:10:26.410637 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:26.410614    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbe95b5_12d9_4712_9254_b27e6fda1be6.slice/crio-01f5570ac68a0d05fb34c209a745ee0e1ef5c28ddf6cbc2f92d685f6997e9c75 WatchSource:0}: Error finding container 01f5570ac68a0d05fb34c209a745ee0e1ef5c28ddf6cbc2f92d685f6997e9c75: Status 404 returned error can't find the container with id 01f5570ac68a0d05fb34c209a745ee0e1ef5c28ddf6cbc2f92d685f6997e9c75
Sep 06 01:10:26.426644 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-metrics-client-ca\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.426736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.426789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.426830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-grpc-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.426883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszgq\" (UniqueName: \"kubernetes.io/projected/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-kube-api-access-nszgq\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.426949 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.427002 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.427002 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.426993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.427410 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.427386    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-metrics-client-ca\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.429781 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.429758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.429878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.429777    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.429878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.429866    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-grpc-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.430038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.430018    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-tls\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.430254 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.430236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.430388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.430371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.434282 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.434264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszgq\" (UniqueName: \"kubernetes.io/projected/50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7-kube-api-access-nszgq\") pod \"thanos-querier-5655fbb567-rdq4h\" (UID: \"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7\") " pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.611757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.611681    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:26.695115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.695043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:26.787640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.787589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:26.807752 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.807720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kzfxt"
Sep 06 01:10:26.847961 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.847919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs" event={"ID":"6fbe95b5-12d9-4712-9254-b27e6fda1be6","Type":"ContainerStarted","Data":"01f5570ac68a0d05fb34c209a745ee0e1ef5c28ddf6cbc2f92d685f6997e9c75"}
Sep 06 01:10:26.850746 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.850716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6p9j" event={"ID":"6577b814-9e03-4121-8b06-6b050e4e138e","Type":"ContainerStarted","Data":"13f2b4da0c67a37381c8ff4799534a941aec151f7d264429dc9de09df8464bae"}
Sep 06 01:10:26.850863 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.850771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f6p9j" event={"ID":"6577b814-9e03-4121-8b06-6b050e4e138e","Type":"ContainerStarted","Data":"bd85296b3adbaa0d0e917c0291063722fe741b3d9899269d5945fa33d24bfdd1"}
Sep 06 01:10:26.869489 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.869441    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f6p9j" podStartSLOduration=1.8482028929999998 podStartE2EDuration="2.869425113s" totalImagesPullingTime="944.00257ms" totalInitContainerRuntime="77.21965ms" isStatefulPod=true podCreationTimestamp="2026-09-06 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:26.868045638 +0000 UTC m=+56.870527224" watchObservedRunningTime="2026-09-06 01:10:26.869425113 +0000 UTC m=+56.871906678"
Sep 06 01:10:26.925100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.925075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5655fbb567-rdq4h"]
Sep 06 01:10:26.927872 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:26.927846    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f3e34f_fbe9_4d54_a9ad_fecc46bfd9b7.slice/crio-7eb6f774200f8b52229a4fbefe5a4df4c341700069f4815a9c1d85bd26e47c7c WatchSource:0}: Error finding container 7eb6f774200f8b52229a4fbefe5a4df4c341700069f4815a9c1d85bd26e47c7c: Status 404 returned error can't find the container with id 7eb6f774200f8b52229a4fbefe5a4df4c341700069f4815a9c1d85bd26e47c7c
Sep 06 01:10:26.966699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:26.966679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.059744 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.059701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.252218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.252118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.330655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.330620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.490521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.490489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.642075 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.642030    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.720198 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.720156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.814229 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.814166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:27.861081 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.861050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9" event={"ID":"0541adff-c7af-4e9b-811f-4e3367908c79","Type":"ContainerStarted","Data":"aa1c4d147521aa25518f163a2a3211fe316aac8749ba4972c690d52fbd585da7"}
Sep 06 01:10:27.862943 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.862915    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"7eb6f774200f8b52229a4fbefe5a4df4c341700069f4815a9c1d85bd26e47c7c"}
Sep 06 01:10:27.865266 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.865242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs" event={"ID":"6fbe95b5-12d9-4712-9254-b27e6fda1be6","Type":"ContainerStarted","Data":"1b2fcaa15ee1d170536156ea960e47ed4d340b8a27e68e22d52f28626b1ac4bb"}
Sep 06 01:10:27.883506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.882478    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-2l8x9" podStartSLOduration=2.768748347 podStartE2EDuration="3.882463337s" totalImagesPullingTime="1.11371499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:27.881169283 +0000 UTC m=+57.883650848" watchObservedRunningTime="2026-09-06 01:10:27.882463337 +0000 UTC m=+57.884944904"
Sep 06 01:10:27.893713 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:27.893645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:28.626078 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.624947    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-587bf8b95c-k2zfj"]
Sep 06 01:10:28.627502 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.627479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.631481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.631302    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 06 01:10:28.631481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.631315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 06 01:10:28.631481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.631358    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4fksdq5bmf7lc\""
Sep 06 01:10:28.631481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.631419    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 06 01:10:28.631767 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.631630    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 06 01:10:28.632655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.632335    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lql6l\""
Sep 06 01:10:28.651008 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.650984    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-587bf8b95c-k2zfj"]
Sep 06 01:10:28.715212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.715168    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:28.715382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.715302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:28.720018 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.719991    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:28.749394 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-metrics-server-audit-profiles\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-client-certs\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749693 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpnkz\" (UniqueName: \"kubernetes.io/projected/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-kube-api-access-jpnkz\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749743 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-audit-log\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-tls\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.749892 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.749860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-client-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-audit-log\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850569    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-tls\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-client-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-metrics-server-audit-profiles\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-client-certs\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.850910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-audit-log\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.851149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.850930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpnkz\" (UniqueName: \"kubernetes.io/projected/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-kube-api-access-jpnkz\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.851435 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.851414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.851929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.851902    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-metrics-server-audit-profiles\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.853274 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.853251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-client-ca-bundle\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.853371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.853354    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-client-certs\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.853745 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.853728    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-secret-metrics-server-tls\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.864426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.864404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpnkz\" (UniqueName: \"kubernetes.io/projected/8960d23b-38cd-4a4a-8f25-d1f6ec89802a-kube-api-access-jpnkz\") pod \"metrics-server-587bf8b95c-k2zfj\" (UID: \"8960d23b-38cd-4a4a-8f25-d1f6ec89802a\") " pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.872777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.872745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs" event={"ID":"6fbe95b5-12d9-4712-9254-b27e6fda1be6","Type":"ContainerStarted","Data":"35eaf30a81f13d481af7b0a850af9cdb4029dd02cf2bb6af4dc4c0328ba91092"}
Sep 06 01:10:28.872876 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.872807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs" event={"ID":"6fbe95b5-12d9-4712-9254-b27e6fda1be6","Type":"ContainerStarted","Data":"01419266a607ae657b9dea1d0bdb0064a6af5f85416e116d730774579f35c173"}
Sep 06 01:10:28.877060 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.876984    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:10:28.896689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.896640    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-xqnbs" podStartSLOduration=3.5680806880000002 podStartE2EDuration="4.896622364s" totalImagesPullingTime="1.328541676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:28.89540743 +0000 UTC m=+58.897888996" watchObservedRunningTime="2026-09-06 01:10:28.896622364 +0000 UTC m=+58.899103931"
Sep 06 01:10:28.942102 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.941868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:28.943693 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:28.943670    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:29.060987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.060964    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"]
Sep 06 01:10:29.063556 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.063536    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.066039 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.065967    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 06 01:10:29.066335 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.066313    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-6826b\""
Sep 06 01:10:29.074854 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.074813    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"]
Sep 06 01:10:29.075346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.075319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:29.154000 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.153933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.154134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.154006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkft8\" (UniqueName: \"kubernetes.io/projected/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-kube-api-access-pkft8\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.166809 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.166780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:29.226442 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.226415    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-587bf8b95c-k2zfj"]
Sep 06 01:10:29.229790 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:29.229764    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8960d23b_38cd_4a4a_8f25_d1f6ec89802a.slice/crio-b61c4dc393d7ab05254484d3a775372b55f0a33aa141d0d80e25f5229fd66e5a WatchSource:0}: Error finding container b61c4dc393d7ab05254484d3a775372b55f0a33aa141d0d80e25f5229fd66e5a: Status 404 returned error can't find the container with id b61c4dc393d7ab05254484d3a775372b55f0a33aa141d0d80e25f5229fd66e5a
Sep 06 01:10:29.254936 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.254914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.255052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.254998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkft8\" (UniqueName: \"kubernetes.io/projected/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-kube-api-access-pkft8\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.257360 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.257338    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.262439 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.262414    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkft8\" (UniqueName: \"kubernetes.io/projected/15b2b662-c261-42fb-8aa0-d39efa0bf1c1-kube-api-access-pkft8\") pod \"monitoring-plugin-85bbbbbf4-jxpqm\" (UID: \"15b2b662-c261-42fb-8aa0-d39efa0bf1c1\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.267574 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.267552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:29.368794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.368762    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:29.372737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.372720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:29.408487 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.408397    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:10:29.411450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.411427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.422378 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.422345    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:10:29.456124 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456328 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456328 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdm4\" (UniqueName: \"kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456383 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.456415 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.456390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557467 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdm4\" (UniqueName: \"kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.557888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.557676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.558351 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.558319    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.558480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.558407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.558480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.558454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.558875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.558850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.560268 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.560250    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.560353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.560326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.565056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.565029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdm4\" (UniqueName: \"kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4\") pod \"console-6cdf44f4d4-4ztnz\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") " pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.642356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.642249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"]
Sep 06 01:10:29.644811 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:29.644788    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b2b662_c261_42fb_8aa0_d39efa0bf1c1.slice/crio-2b8c2784e1b2be018555e890b50246d9eab5e1bf93ea48d48e487e85e90b0a03 WatchSource:0}: Error finding container 2b8c2784e1b2be018555e890b50246d9eab5e1bf93ea48d48e487e85e90b0a03: Status 404 returned error can't find the container with id 2b8c2784e1b2be018555e890b50246d9eab5e1bf93ea48d48e487e85e90b0a03
Sep 06 01:10:29.723437 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.723377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:29.878003 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.877966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm" event={"ID":"15b2b662-c261-42fb-8aa0-d39efa0bf1c1","Type":"ContainerStarted","Data":"2b8c2784e1b2be018555e890b50246d9eab5e1bf93ea48d48e487e85e90b0a03"}
Sep 06 01:10:29.880506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.880473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"486bba5d31c8cd01d94371330005576b7bdaf144ae09734ffa83b13b8ce25970"}
Sep 06 01:10:29.880627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.880561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"4d1159a14e0c84474d2c764361a8c8e00879b8386a37c46c2e05d1f47171fb42"}
Sep 06 01:10:29.880627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.880605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"c808030bf7402f49dc09537d56b2fe423f4d8d864039132a6c6bc4c4d49ae7d8"}
Sep 06 01:10:29.881919 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.881865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj" event={"ID":"8960d23b-38cd-4a4a-8f25-d1f6ec89802a","Type":"ContainerStarted","Data":"b61c4dc393d7ab05254484d3a775372b55f0a33aa141d0d80e25f5229fd66e5a"}
Sep 06 01:10:29.993788 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:29.993713    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:10:30.061051 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:30.061018    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7b8c4c_6850_4ab3_8827_1066f8dc3993.slice/crio-ea575ea7f363e3e7312de838a97099079468d884e28b290f9efeba1bb5cd6eb3 WatchSource:0}: Error finding container ea575ea7f363e3e7312de838a97099079468d884e28b290f9efeba1bb5cd6eb3: Status 404 returned error can't find the container with id ea575ea7f363e3e7312de838a97099079468d884e28b290f9efeba1bb5cd6eb3
Sep 06 01:10:30.199012 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.198986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:30.298670 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.298640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:30.562997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.562915    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:10:30.568126 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.568052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:30.571397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.571368    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.574104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574083    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 06 01:10:30.574392 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574370    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 06 01:10:30.574481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1b15qtmq91hfb\""
Sep 06 01:10:30.574481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574418    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 06 01:10:30.574662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 06 01:10:30.574836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574822    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 06 01:10:30.574895 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574858    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 06 01:10:30.574952 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.574921    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 06 01:10:30.575112 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575096    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 06 01:10:30.575224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 06 01:10:30.575761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575446    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 06 01:10:30.575761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575461    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dchzw\""
Sep 06 01:10:30.575761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575470    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 06 01:10:30.575761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575538    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 06 01:10:30.576052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.575992    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 06 01:10:30.578878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.578709    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 06 01:10:30.590626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.590598    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:10:30.668586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.668586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqj6\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.668976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669162    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.669883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.669265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.751296 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.751252    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-js5jq"
Sep 06 01:10:30.770438 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770517    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770742    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770766    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.770915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.770868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqj6\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.773500 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.772536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.773960 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.773634    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.775334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.775308    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.775779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.775758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.776682 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.776654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.777030 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.777002    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.777926 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.777900    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.779326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.778727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.779326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.779171    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.779467 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.779430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.779522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.779471    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.779724 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.779696    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.780258 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.780234    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.780726 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.780703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.782307 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.782268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.783899 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.783412    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.784955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.784921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.785460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.785440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.789843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.788473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.792454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.792432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqj6\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6\") pod \"prometheus-k8s-0\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.883530 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.882970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:30.897206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.897016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"401880e283e8da33c52605727b95f8359fb3b55efbfe8319b531cbd7964ee899"}
Sep 06 01:10:30.897206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.897088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"6e53649639e8b5d3cf20d0418f1493c92e504e2ec6c091da3272cc81441d0890"}
Sep 06 01:10:30.897206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.897118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" event={"ID":"50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7","Type":"ContainerStarted","Data":"4e43a6722d865f72b2f7d6a5a302c10ce25ff7fbd962a51e6246bfb91f478a02"}
Sep 06 01:10:30.897206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.897204    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:30.900526 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.900487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf44f4d4-4ztnz" event={"ID":"fb7b8c4c-6850-4ab3-8827-1066f8dc3993","Type":"ContainerStarted","Data":"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"}
Sep 06 01:10:30.900649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.900549    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf44f4d4-4ztnz" event={"ID":"fb7b8c4c-6850-4ab3-8827-1066f8dc3993","Type":"ContainerStarted","Data":"ea575ea7f363e3e7312de838a97099079468d884e28b290f9efeba1bb5cd6eb3"}
Sep 06 01:10:30.904454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.904431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:30.963269 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.963214    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cdf44f4d4-4ztnz" podStartSLOduration=1.963172565 podStartE2EDuration="1.963172565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:30.962918831 +0000 UTC m=+60.965400422" watchObservedRunningTime="2026-09-06 01:10:30.963172565 +0000 UTC m=+60.965654131"
Sep 06 01:10:30.964702 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:30.964657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h" podStartSLOduration=2.008416172 podStartE2EDuration="4.964642782s" totalImagesPullingTime="2.95622661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:30.93320272 +0000 UTC m=+60.935684278" watchObservedRunningTime="2026-09-06 01:10:30.964642782 +0000 UTC m=+60.967124349"
Sep 06 01:10:31.003203 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:31.003136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:31.298450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:31.298426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:10:31.300077 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:31.300057    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a012b10_dd87_4d71_923a_91dff3282f69.slice/crio-bdc264f621acf15d67120eb619d72c4919cc0f34a63d6eb42e9d06bfc51c0b31 WatchSource:0}: Error finding container bdc264f621acf15d67120eb619d72c4919cc0f34a63d6eb42e9d06bfc51c0b31: Status 404 returned error can't find the container with id bdc264f621acf15d67120eb619d72c4919cc0f34a63d6eb42e9d06bfc51c0b31
Sep 06 01:10:31.909316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:31.909272    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj" event={"ID":"8960d23b-38cd-4a4a-8f25-d1f6ec89802a","Type":"ContainerStarted","Data":"bff687ed9a534574f1e95bf570e9507eec0d17e56152743596930dc734d96bc7"}
Sep 06 01:10:31.910707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:31.910678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"bdc264f621acf15d67120eb619d72c4919cc0f34a63d6eb42e9d06bfc51c0b31"}
Sep 06 01:10:31.930632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:31.930592    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj" podStartSLOduration=2.119800531 podStartE2EDuration="3.930575606s" totalImagesPullingTime="1.810775075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:31.929469618 +0000 UTC m=+61.931951184" watchObservedRunningTime="2026-09-06 01:10:31.930575606 +0000 UTC m=+61.933057173"
Sep 06 01:10:32.915796 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.915762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm" event={"ID":"15b2b662-c261-42fb-8aa0-d39efa0bf1c1","Type":"ContainerStarted","Data":"00563566f6eb819bcd4b12f6b66b1b83beeceece1c630919d59ee5b523e73c41"}
Sep 06 01:10:32.916241 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.915826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:32.917356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.917329    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8" exitCode=0
Sep 06 01:10:32.917490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.917428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"}
Sep 06 01:10:32.921100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.921082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm"
Sep 06 01:10:32.937907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:32.937862    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-jxpqm" podStartSLOduration=1.66561111 podStartE2EDuration="3.937849358s" totalImagesPullingTime="2.272238248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:32.936878406 +0000 UTC m=+62.939359972" watchObservedRunningTime="2026-09-06 01:10:32.937849358 +0000 UTC m=+62.940330925"
Sep 06 01:10:33.765419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.765367    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:10:33.793670 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.793638    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:10:33.795912 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.795892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.809563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.809541    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:10:33.906024 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.905991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906246    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgjbx\" (UniqueName: \"kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:33.906369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:33.906354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007124 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007124 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007143    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgjbx\" (UniqueName: \"kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007233    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.007652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.008000 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.007977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.008066 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.008048    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.008371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.008348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.008825 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.008803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.009830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.009815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.010020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.010003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.016047 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.015997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgjbx\" (UniqueName: \"kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx\") pod \"console-77f5656c8d-9hmsl\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") " pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.108128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.107922    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:34.163569 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.163498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:34.263243 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.263211    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:34.392606 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.392475    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:10:34.394991 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:34.394965    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708ff289_8332_4fb9_ada0_3301c749c0c1.slice/crio-f1b110ca45dd42dd0c9855dfa519261b9f60ff3379fff038ad622c79844b8c3d WatchSource:0}: Error finding container f1b110ca45dd42dd0c9855dfa519261b9f60ff3379fff038ad622c79844b8c3d: Status 404 returned error can't find the container with id f1b110ca45dd42dd0c9855dfa519261b9f60ff3379fff038ad622c79844b8c3d
Sep 06 01:10:34.810205 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.810104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:34.910323 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.910279    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:34.932252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.932218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f5656c8d-9hmsl" event={"ID":"708ff289-8332-4fb9-ada0-3301c749c0c1","Type":"ContainerStarted","Data":"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"}
Sep 06 01:10:34.932397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.932277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f5656c8d-9hmsl" event={"ID":"708ff289-8332-4fb9-ada0-3301c749c0c1","Type":"ContainerStarted","Data":"f1b110ca45dd42dd0c9855dfa519261b9f60ff3379fff038ad622c79844b8c3d"}
Sep 06 01:10:34.952045 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:34.951985    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77f5656c8d-9hmsl" podStartSLOduration=1.951962783 podStartE2EDuration="1.951962783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:34.950309765 +0000 UTC m=+64.952791347" watchObservedRunningTime="2026-09-06 01:10:34.951962783 +0000 UTC m=+64.954444349"
Sep 06 01:10:36.331986 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.331947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:36.332390 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.332036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:36.335019 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.334684    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:10:36.335019 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.334928    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:10:36.344681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.344648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce7ebc37-0238-41aa-a1d0-911f61a0ecb1-metrics-certs\") pod \"network-metrics-daemon-8nxgv\" (UID: \"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1\") " pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:36.345076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.345054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c731e94b-ea94-46f5-975a-7a356865f7db-original-pull-secret\") pod \"global-pull-secret-syncer-n97kl\" (UID: \"c731e94b-ea94-46f5-975a-7a356865f7db\") " pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:36.432792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.432751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:36.435319 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.435298    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 01:10:36.446635 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.446565    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 01:10:36.458567 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.458520    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5t5\" (UniqueName: \"kubernetes.io/projected/ba68e4a3-0a93-4bb4-b999-f169bca4f4e0-kube-api-access-xj5t5\") pod \"network-check-target-jfdkq\" (UID: \"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0\") " pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:36.489324 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.489300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n97kl"
Sep 06 01:10:36.501441 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.501235    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:10:36.509070 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.509032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:36.509400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.509378    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:10:36.517538 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.517382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nxgv"
Sep 06 01:10:36.586194 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.585821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:36.685765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.685736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:36.773796 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.773775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n97kl"]
Sep 06 01:10:36.776238 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:36.776214    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc731e94b_ea94_46f5_975a_7a356865f7db.slice/crio-67450593824c8e8387996e144802d647d1e7b494d3aeecef51d70fd6aa00e30a WatchSource:0}: Error finding container 67450593824c8e8387996e144802d647d1e7b494d3aeecef51d70fd6aa00e30a: Status 404 returned error can't find the container with id 67450593824c8e8387996e144802d647d1e7b494d3aeecef51d70fd6aa00e30a
Sep 06 01:10:36.810793 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.810773    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jfdkq"]
Sep 06 01:10:36.812979 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:36.812952    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba68e4a3_0a93_4bb4_b999_f169bca4f4e0.slice/crio-4bd3be387ded35c85ae2e129f309bad2c7617c3e80555063d8848a583cc57040 WatchSource:0}: Error finding container 4bd3be387ded35c85ae2e129f309bad2c7617c3e80555063d8848a583cc57040: Status 404 returned error can't find the container with id 4bd3be387ded35c85ae2e129f309bad2c7617c3e80555063d8848a583cc57040
Sep 06 01:10:36.830216 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.830197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nxgv"]
Sep 06 01:10:36.832135 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:10:36.832113    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7ebc37_0238_41aa_a1d0_911f61a0ecb1.slice/crio-7a9bac42186b76e595f01595df63eda9f9c0e6ba101fa47cb693a86f2bdab9a6 WatchSource:0}: Error finding container 7a9bac42186b76e595f01595df63eda9f9c0e6ba101fa47cb693a86f2bdab9a6: Status 404 returned error can't find the container with id 7a9bac42186b76e595f01595df63eda9f9c0e6ba101fa47cb693a86f2bdab9a6
Sep 06 01:10:36.916651 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.916627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5655fbb567-rdq4h"
Sep 06 01:10:36.944506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.944478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nxgv" event={"ID":"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1","Type":"ContainerStarted","Data":"7a9bac42186b76e595f01595df63eda9f9c0e6ba101fa47cb693a86f2bdab9a6"}
Sep 06 01:10:36.948479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"}
Sep 06 01:10:36.948640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"}
Sep 06 01:10:36.948640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"}
Sep 06 01:10:36.948640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"}
Sep 06 01:10:36.948748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"}
Sep 06 01:10:36.948748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.948685    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerStarted","Data":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"}
Sep 06 01:10:36.951506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.951472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n97kl" event={"ID":"c731e94b-ea94-46f5-975a-7a356865f7db","Type":"ContainerStarted","Data":"67450593824c8e8387996e144802d647d1e7b494d3aeecef51d70fd6aa00e30a"}
Sep 06 01:10:36.952870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.952835    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfdkq" event={"ID":"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0","Type":"ContainerStarted","Data":"4bd3be387ded35c85ae2e129f309bad2c7617c3e80555063d8848a583cc57040"}
Sep 06 01:10:36.978748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:36.978683    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.485449034 podStartE2EDuration="6.978660838s" totalImagesPullingTime="4.475100595s" totalInitContainerRuntime="18.111209ms" isStatefulPod=false podCreationTimestamp="2026-09-06 01:10:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:36.976232224 +0000 UTC m=+66.978713791" watchObservedRunningTime="2026-09-06 01:10:36.978660838 +0000 UTC m=+66.981142404"
Sep 06 01:10:38.965729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:38.965688    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nxgv" event={"ID":"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1","Type":"ContainerStarted","Data":"86f50f7c0f3bf25ff53632f5c6709c4bb03c90c0c0f141a6558437147f9609f3"}
Sep 06 01:10:38.966129 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:38.965747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nxgv" event={"ID":"ce7ebc37-0238-41aa-a1d0-911f61a0ecb1","Type":"ContainerStarted","Data":"9c3c268f403cf5f133b567b9ca2217c9603d560f7e8f40b0538df78d13e69df7"}
Sep 06 01:10:38.984119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:38.984067    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8nxgv" podStartSLOduration=66.580942658 podStartE2EDuration="1m7.984052389s" totalImagesPullingTime="1.403109731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:38.981304215 +0000 UTC m=+68.983785783" watchObservedRunningTime="2026-09-06 01:10:38.984052389 +0000 UTC m=+68.986533954"
Sep 06 01:10:39.071553 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:39.071497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:39.144780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:39.144742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:39.723647 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:39.723610    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:40.118541 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:40.118463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:40.179142 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:40.179109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:40.884618 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:40.884578    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:10:41.690421 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.690393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:41.789827 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.789802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:41.981248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.981156    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jfdkq" event={"ID":"ba68e4a3-0a93-4bb4-b999-f169bca4f4e0","Type":"ContainerStarted","Data":"f0981a0d945ed4e68c93b1c5c0658d493dde54c9d7487abdcdc7a5444d148fc5"}
Sep 06 01:10:41.981410 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.981265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:10:41.982663 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.982639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n97kl" event={"ID":"c731e94b-ea94-46f5-975a-7a356865f7db","Type":"ContainerStarted","Data":"907fd52eea0267764089f9aa2e41dfa4700c5aeafb65e3290fff7253b4e0c57e"}
Sep 06 01:10:41.996792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:41.996744    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jfdkq" podStartSLOduration=67.136778747 podStartE2EDuration="1m11.99673084s" totalImagesPullingTime="4.859952093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:41.996136921 +0000 UTC m=+71.998618488" watchObservedRunningTime="2026-09-06 01:10:41.99673084 +0000 UTC m=+71.999212407"
Sep 06 01:10:42.011612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:42.011567    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n97kl" podStartSLOduration=66.110865882 podStartE2EDuration="1m11.011554116s" totalImagesPullingTime="4.900688234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:42.0101469 +0000 UTC m=+72.012628468" watchObservedRunningTime="2026-09-06 01:10:42.011554116 +0000 UTC m=+72.014035682"
Sep 06 01:10:44.108836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:44.108792    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:44.109247 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:44.108873    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:44.113772 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:44.113751    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:44.998415 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:44.998387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:10:45.050481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:45.050451    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:10:45.176772 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:45.176738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:45.227855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:45.227826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:45.294949 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:45.294874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:48.942823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:48.942788    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:48.943254 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:48.942855    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:10:53.972829 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:53.972712    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d896d548d-59q5c" podUID="1f87a851-c41e-42f5-a706-54f4807c9046" containerName="console" containerID="cri-o://73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1" gracePeriod=15
Sep 06 01:10:54.211347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.211321    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:54.400404 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400442    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400463    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400535    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7wbj\" (UniqueName: \"kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj\") pod \"1f87a851-c41e-42f5-a706-54f4807c9046\" (UID: \"1f87a851-c41e-42f5-a706-54f4807c9046\") "
Sep 06 01:10:54.400944 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400914    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config" (OuterVolumeSpecName: "console-config") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:54.400944 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400928    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:54.401064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.400968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:54.402821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.402801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:54.403315 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.403296    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:54.403396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.403332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj" (OuterVolumeSpecName: "kube-api-access-t7wbj") pod "1f87a851-c41e-42f5-a706-54f4807c9046" (UID: "1f87a851-c41e-42f5-a706-54f4807c9046"). InnerVolumeSpecName "kube-api-access-t7wbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:54.501107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501082    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.501107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501103    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.501263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501113    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.501263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501121    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f87a851-c41e-42f5-a706-54f4807c9046-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.501263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501129    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f87a851-c41e-42f5-a706-54f4807c9046-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.501263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.501138    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7wbj\" (UniqueName: \"kubernetes.io/projected/1f87a851-c41e-42f5-a706-54f4807c9046-kube-api-access-t7wbj\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:54.862453 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.862368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:54.963363 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:54.963336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:55.036149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.036113    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f87a851-c41e-42f5-a706-54f4807c9046" containerID="73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1" exitCode=0
Sep 06 01:10:55.036630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.036197    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d896d548d-59q5c"
Sep 06 01:10:55.036630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.036203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d896d548d-59q5c" event={"ID":"1f87a851-c41e-42f5-a706-54f4807c9046","Type":"ContainerDied","Data":"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"}
Sep 06 01:10:55.036630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.036242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d896d548d-59q5c" event={"ID":"1f87a851-c41e-42f5-a706-54f4807c9046","Type":"ContainerDied","Data":"36ff252edc1a03d22df323f863eaeca1a469c48756584b69f09ef754f40b8a05"}
Sep 06 01:10:55.036630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.036260    2582 scope.go:117] "RemoveContainer" containerID="73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"
Sep 06 01:10:55.044835 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.044817    2582 scope.go:117] "RemoveContainer" containerID="73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"
Sep 06 01:10:55.045120 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:55.045104    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1\": container with ID starting with 73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1 not found: ID does not exist" containerID="73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"
Sep 06 01:10:55.045166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.045128    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1"} err="failed to get container status \"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1\": rpc error: code = NotFound desc = could not find container \"73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1\": container with ID starting with 73a457af151ee399231f0e8b5c3fad55fe23d18c7b5046d520b3da8e51e6fdd1 not found: ID does not exist"
Sep 06 01:10:55.052379 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.052359    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:55.054917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.054896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:55.055201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:55.055161    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d896d548d-59q5c"]
Sep 06 01:10:56.476333 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:56.476300    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f87a851-c41e-42f5-a706-54f4807c9046" path="/var/lib/kubelet/pods/1f87a851-c41e-42f5-a706-54f4807c9046/volumes"
Sep 06 01:10:56.691432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:56.691403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:56.750828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:56.750745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:58.540999 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:58.540965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:58.642716 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:58.642677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:10:58.788891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:58.788842    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6cdf44f4d4-4ztnz" podUID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" containerName="console" containerID="cri-o://c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823" gracePeriod=15
Sep 06 01:10:59.037756 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.037731    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:59.053269 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.053214    2582 generic.go:356] "Generic (PLEG): container finished" podID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" containerID="c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823" exitCode=0
Sep 06 01:10:59.053269 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.053264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf44f4d4-4ztnz" event={"ID":"fb7b8c4c-6850-4ab3-8827-1066f8dc3993","Type":"ContainerDied","Data":"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"}
Sep 06 01:10:59.053430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.053275    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cdf44f4d4-4ztnz"
Sep 06 01:10:59.053430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.053330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cdf44f4d4-4ztnz" event={"ID":"fb7b8c4c-6850-4ab3-8827-1066f8dc3993","Type":"ContainerDied","Data":"ea575ea7f363e3e7312de838a97099079468d884e28b290f9efeba1bb5cd6eb3"}
Sep 06 01:10:59.053430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.053352    2582 scope.go:117] "RemoveContainer" containerID="c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"
Sep 06 01:10:59.062222 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.062204    2582 scope.go:117] "RemoveContainer" containerID="c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"
Sep 06 01:10:59.062568 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:10:59.062546    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823\": container with ID starting with c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823 not found: ID does not exist" containerID="c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"
Sep 06 01:10:59.062637 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.062579    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823"} err="failed to get container status \"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823\": rpc error: code = NotFound desc = could not find container \"c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823\": container with ID starting with c9eefe47041bc018c951f3e7fe8071d710f6042fa663557f722cf97e566b2823 not found: ID does not exist"
Sep 06 01:10:59.144604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.144776 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wdm4\" (UniqueName: \"kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.144776 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.144899 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144841    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.144899 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144874    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.145012 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144918    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.145012 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.144940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config\") pod \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\" (UID: \"fb7b8c4c-6850-4ab3-8827-1066f8dc3993\") "
Sep 06 01:10:59.145365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.145314    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca" (OuterVolumeSpecName: "service-ca") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:59.145365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.145316    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:59.145627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.145593    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config" (OuterVolumeSpecName: "console-config") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:59.145708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.145686    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:59.146982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.146951    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:59.147063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.146978    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4" (OuterVolumeSpecName: "kube-api-access-9wdm4") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "kube-api-access-9wdm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:59.147063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.147020    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fb7b8c4c-6850-4ab3-8827-1066f8dc3993" (UID: "fb7b8c4c-6850-4ab3-8827-1066f8dc3993"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:59.246469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246447    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246469    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wdm4\" (UniqueName: \"kubernetes.io/projected/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-kube-api-access-9wdm4\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246478    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246486    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246495    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246505    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.246664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.246518    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fb7b8c4c-6850-4ab3-8827-1066f8dc3993-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:10:59.374437 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.374403    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:10:59.377814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:10:59.377793    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cdf44f4d4-4ztnz"]
Sep 06 01:11:00.475940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:00.475906    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" path="/var/lib/kubelet/pods/fb7b8c4c-6850-4ab3-8827-1066f8dc3993/volumes"
Sep 06 01:11:03.055984 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:03.055950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:03.156890 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:03.156856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:08.949110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:08.949013    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:11:08.953069 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:08.953048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-587bf8b95c-k2zfj"
Sep 06 01:11:10.076134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.076068    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77db7755f6-mlftp" podUID="8b25fc25-917d-45df-a6f9-986f7028d0c8" containerName="console" containerID="cri-o://c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383" gracePeriod=15
Sep 06 01:11:10.364527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.364494    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:11:10.438908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.438881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntpsf\" (UniqueName: \"kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439072 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.438939    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439072 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.438962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439072 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.438979    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439264 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439264 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439164    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439264 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439236    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca\") pod \"8b25fc25-917d-45df-a6f9-986f7028d0c8\" (UID: \"8b25fc25-917d-45df-a6f9-986f7028d0c8\") "
Sep 06 01:11:10.439458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:10.439525 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439507    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:10.439571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config" (OuterVolumeSpecName: "console-config") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:10.439571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439564    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.439846 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.439750    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:10.441434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.441408    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:10.441524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.441410    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf" (OuterVolumeSpecName: "kube-api-access-ntpsf") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "kube-api-access-ntpsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:11:10.441524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.441476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b25fc25-917d-45df-a6f9-986f7028d0c8" (UID: "8b25fc25-917d-45df-a6f9-986f7028d0c8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:10.540104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540078    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.540104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540101    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntpsf\" (UniqueName: \"kubernetes.io/projected/8b25fc25-917d-45df-a6f9-986f7028d0c8-kube-api-access-ntpsf\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.540272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540111    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.540272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540126    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.540272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540138    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:10.540272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:10.540146    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b25fc25-917d-45df-a6f9-986f7028d0c8-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:11.102897 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.102861    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b25fc25-917d-45df-a6f9-986f7028d0c8" containerID="c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383" exitCode=0
Sep 06 01:11:11.103302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.102905    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77db7755f6-mlftp"
Sep 06 01:11:11.103302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.102948    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77db7755f6-mlftp" event={"ID":"8b25fc25-917d-45df-a6f9-986f7028d0c8","Type":"ContainerDied","Data":"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"}
Sep 06 01:11:11.103302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.103001    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77db7755f6-mlftp" event={"ID":"8b25fc25-917d-45df-a6f9-986f7028d0c8","Type":"ContainerDied","Data":"06a8ed1ff453a2ca10a1cd0cdab3bf9da4ca6b98e13f6a10add043c71125b683"}
Sep 06 01:11:11.103302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.103021    2582 scope.go:117] "RemoveContainer" containerID="c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"
Sep 06 01:11:11.111114 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.111099    2582 scope.go:117] "RemoveContainer" containerID="c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"
Sep 06 01:11:11.111384 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:11.111368    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383\": container with ID starting with c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383 not found: ID does not exist" containerID="c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"
Sep 06 01:11:11.111438 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.111393    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383"} err="failed to get container status \"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383\": rpc error: code = NotFound desc = could not find container \"c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383\": container with ID starting with c909d45d8a10b5efa15b32b866218fc48b87ce2eb0542f2cd83b8c6efb922383 not found: ID does not exist"
Sep 06 01:11:11.119206 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.119167    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:11:11.122681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:11.122662    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77db7755f6-mlftp"]
Sep 06 01:11:12.480098 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:12.480064    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b25fc25-917d-45df-a6f9-986f7028d0c8" path="/var/lib/kubelet/pods/8b25fc25-917d-45df-a6f9-986f7028d0c8/volumes"
Sep 06 01:11:12.989114 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:12.989086    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jfdkq"
Sep 06 01:11:15.805477 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:15.805431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:30.883727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:30.883695    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:30.903679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:30.903655    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:31.214088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:31.214019    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:31.963864 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:31.963828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:32.018699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:32.018666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:40.408417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:40.408378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:40.466768 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:40.466728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:45.387814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.387782    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388095    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f87a851-c41e-42f5-a706-54f4807c9046" containerName="console"
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388106    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f87a851-c41e-42f5-a706-54f4807c9046" containerName="console"
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388124    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" containerName="console"
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388134    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" containerName="console"
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388154    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b25fc25-917d-45df-a6f9-986f7028d0c8" containerName="console"
Sep 06 01:11:45.388215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388162    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b25fc25-917d-45df-a6f9-986f7028d0c8" containerName="console"
Sep 06 01:11:45.388402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388242    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb7b8c4c-6850-4ab3-8827-1066f8dc3993" containerName="console"
Sep 06 01:11:45.388402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388252    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b25fc25-917d-45df-a6f9-986f7028d0c8" containerName="console"
Sep 06 01:11:45.388402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.388258    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f87a851-c41e-42f5-a706-54f4807c9046" containerName="console"
Sep 06 01:11:45.391768 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.391747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.400887 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.400864    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:11:45.443667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443871 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443871 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443871 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkll2\" (UniqueName: \"kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.443997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.443921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.444656 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.444636    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:45.494941 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.494909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:45.545329 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkll2\" (UniqueName: \"kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545559 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545559 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545643 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.545643 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.545613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.546156 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.546128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.546298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.546247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.546298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.546270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.546491 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.546467    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.548686 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.548663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.548774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.548689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.552921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.552895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkll2\" (UniqueName: \"kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2\") pod \"console-76cb7d7db9-8426m\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") " pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.701055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.700961    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:45.972495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:45.972417    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:11:45.975617 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:11:45.975589    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5775a9b1_8f4b_4148_91b9_4f6726951ded.slice/crio-3a61163ceff25d502acae03a6e489a23b757338b80bc220b96c1cd62d30518dc WatchSource:0}: Error finding container 3a61163ceff25d502acae03a6e489a23b757338b80bc220b96c1cd62d30518dc: Status 404 returned error can't find the container with id 3a61163ceff25d502acae03a6e489a23b757338b80bc220b96c1cd62d30518dc
Sep 06 01:11:46.258604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:46.258517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cb7d7db9-8426m" event={"ID":"5775a9b1-8f4b-4148-91b9-4f6726951ded","Type":"ContainerStarted","Data":"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"}
Sep 06 01:11:46.258604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:46.258561    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cb7d7db9-8426m" event={"ID":"5775a9b1-8f4b-4148-91b9-4f6726951ded","Type":"ContainerStarted","Data":"3a61163ceff25d502acae03a6e489a23b757338b80bc220b96c1cd62d30518dc"}
Sep 06 01:11:46.276485 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:46.276434    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76cb7d7db9-8426m" podStartSLOduration=1.276416673 podStartE2EDuration="1.276416673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:46.275059592 +0000 UTC m=+136.277541158" watchObservedRunningTime="2026-09-06 01:11:46.276416673 +0000 UTC m=+136.278898238"
Sep 06 01:11:48.876367 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876331    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:48.876820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876642    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="prometheus" containerID="cri-o://39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000" gracePeriod=600
Sep 06 01:11:48.876820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876684    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="thanos-sidecar" containerID="cri-o://8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02" gracePeriod=600
Sep 06 01:11:48.876820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876687    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy" containerID="cri-o://6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f" gracePeriod=600
Sep 06 01:11:48.876820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876708    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-web" containerID="cri-o://ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b" gracePeriod=600
Sep 06 01:11:48.876820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876747    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="config-reloader" containerID="cri-o://4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387" gracePeriod=600
Sep 06 01:11:48.877078 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:48.876825    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-thanos" containerID="cri-o://38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74" gracePeriod=600
Sep 06 01:11:49.133519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.133446    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.174673 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174731    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174755    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174835    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.174906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174895    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174922    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174946    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.174968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175087    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175162    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlqj6\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175212    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.175457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.175269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db\") pod \"8a012b10-dd87-4d71-923a-91dff3282f69\" (UID: \"8a012b10-dd87-4d71-923a-91dff3282f69\") "
Sep 06 01:11:49.177619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.176723    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:11:49.177619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.177045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.177619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.177125    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.177619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.177412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.177619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.177552    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.178299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.178011    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.178299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.178250    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.178934 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.178820    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.179978 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.179929    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:11:49.181103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.181070    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config" (OuterVolumeSpecName: "config") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.183775 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.183701    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.184108 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184075    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out" (OuterVolumeSpecName: "config-out") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:11:49.184215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184122    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.184293 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184234    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6" (OuterVolumeSpecName: "kube-api-access-nlqj6") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "kube-api-access-nlqj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:11:49.184772 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:11:49.184937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184882    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.185043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.184972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.185508 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.185476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.185590 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.185543    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.195089 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.195054    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config" (OuterVolumeSpecName: "web-config") pod "8a012b10-dd87-4d71-923a-91dff3282f69" (UID: "8a012b10-dd87-4d71-923a-91dff3282f69"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:11:49.272728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272697    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74" exitCode=0
Sep 06 01:11:49.272728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272720    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f" exitCode=0
Sep 06 01:11:49.272728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272728    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b" exitCode=0
Sep 06 01:11:49.272728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272735    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02" exitCode=0
Sep 06 01:11:49.272728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272741    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387" exitCode=0
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272746    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a012b10-dd87-4d71-923a-91dff3282f69" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000" exitCode=0
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272781    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272796    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272877    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272916    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"}
Sep 06 01:11:49.273160 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.272970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8a012b10-dd87-4d71-923a-91dff3282f69","Type":"ContainerDied","Data":"bdc264f621acf15d67120eb619d72c4919cc0f34a63d6eb42e9d06bfc51c0b31"}
Sep 06 01:11:49.276547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276524    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-metrics-client-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276547 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276548    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-config-out\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276558    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276567    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276576    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276595    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-web-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276606    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276614    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-metrics-client-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276623    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276631    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276640    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276648    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-grpc-tls\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276656    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-tls-assets\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276664    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276677    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276692    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276704    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlqj6\" (UniqueName: \"kubernetes.io/projected/8a012b10-dd87-4d71-923a-91dff3282f69-kube-api-access-nlqj6\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276717    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276726    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8a012b10-dd87-4d71-923a-91dff3282f69-secret-kube-rbac-proxy\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.276729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.276733    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8a012b10-dd87-4d71-923a-91dff3282f69-prometheus-k8s-db\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:11:49.281110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.281095    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.288392 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.288378    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.297574 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.297552    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:49.300874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.300855    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.301426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.301407    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:49.307694 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.307676    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.314429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.314412    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.321858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.321842    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.327169 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327148    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:49.327479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327465    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="init-config-reloader"
Sep 06 01:11:49.327520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327481    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="init-config-reloader"
Sep 06 01:11:49.327520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327491    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="thanos-sidecar"
Sep 06 01:11:49.327520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327497    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="thanos-sidecar"
Sep 06 01:11:49.327520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327503    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy"
Sep 06 01:11:49.327520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327508    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327526    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-thanos"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327532    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-thanos"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327546    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-web"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327551    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-web"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327558    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="prometheus"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327562    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="prometheus"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327569    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="config-reloader"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327575    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="config-reloader"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327621    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-thanos"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327629    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy-web"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327636    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="kube-rbac-proxy"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327641    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="thanos-sidecar"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327647    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="config-reloader"
Sep 06 01:11:49.327695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.327653    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" containerName="prometheus"
Sep 06 01:11:49.329386 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.329308    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.330701 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.330615    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.330701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.330658    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.330701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.330682    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.331695 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.331243    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.336085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.335029    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.336085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.335062    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.336085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.332865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.338022 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.337650    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.338022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.337692    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.338022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.337716    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.338492    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.338524    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.338558    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.338890    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339105    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339523    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339617    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 06 01:11:49.339751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339666    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 06 01:11:49.340279 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.339914    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 06 01:11:49.340901 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.340694    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.340901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.340748    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.340901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.340770    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.341080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341003    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1b15qtmq91hfb\""
Sep 06 01:11:49.341080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 06 01:11:49.341589 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 06 01:11:49.341589 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341254    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 06 01:11:49.341836 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.341811    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.341963 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341848    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.341963 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341886    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.341963 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.341893    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 06 01:11:49.342120 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.342002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-dchzw\""
Sep 06 01:11:49.342405 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:11:49.342358    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.342534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.342408    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.342534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.342428    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.342888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.342850    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.342888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.342874    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.343260 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343232    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.343260 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343262    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.343603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343577    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.343603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343600    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.343905 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343884    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.343979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.343906    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.344260 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344233    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.344351 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344261    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.344413 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344393    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 06 01:11:49.344711 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344689    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.344789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344712    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.345013 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.344990    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.345013 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.345011    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.345323 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.345303    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.345411 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.345344    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.345893 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.345868    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.346001 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.345895    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.346171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.346148    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.346171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.346172    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.346794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.346766    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.346876 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.346796    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.347045 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 06 01:11:49.347215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347154    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.347309 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347222    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.347535 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347491    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.347535 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347518    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.347809 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347788    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.347893 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.347811    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.348084 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.348055    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.348203 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.348085    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.348727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.348710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:49.348875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.348851    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.348928 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.348878    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.349162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349144    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.349331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349163    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.349419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349404    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.349462 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349420    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.349669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349647    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.349669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349669    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.349912 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349893    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.349998 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.349913    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.350117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350101    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.350201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350116    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.350357 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350341    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.350357 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350356    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.350623 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350601    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.350706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350623    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.350858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350842    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.350858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.350857    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.351103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351083    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.351146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351106    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.351374 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351355    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.351418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351375    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.351618 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.351666 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351621    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.351827 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351812    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.351864 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.351828    2582 scope.go:117] "RemoveContainer" containerID="38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"
Sep 06 01:11:49.352103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352076    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74"} err="failed to get container status \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": rpc error: code = NotFound desc = could not find container \"38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74\": container with ID starting with 38445634be62b6f3edd7191a8285c917810a7e38767e210fa15cf125c3629a74 not found: ID does not exist"
Sep 06 01:11:49.352158 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352106    2582 scope.go:117] "RemoveContainer" containerID="6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"
Sep 06 01:11:49.352408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352384    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f"} err="failed to get container status \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": rpc error: code = NotFound desc = could not find container \"6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f\": container with ID starting with 6b01514ddbca8e0b1aeed14088c7b37ac55b78b77a434c6d17612144e4e38c5f not found: ID does not exist"
Sep 06 01:11:49.352408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352408    2582 scope.go:117] "RemoveContainer" containerID="ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"
Sep 06 01:11:49.352718 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352699    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b"} err="failed to get container status \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": rpc error: code = NotFound desc = could not find container \"ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b\": container with ID starting with ffc66b642b09146621ac7775de7fdc3dc7303b0fe22c2187970d18936313507b not found: ID does not exist"
Sep 06 01:11:49.352718 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352717    2582 scope.go:117] "RemoveContainer" containerID="8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"
Sep 06 01:11:49.352974 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352955    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02"} err="failed to get container status \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": rpc error: code = NotFound desc = could not find container \"8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02\": container with ID starting with 8335f119576732a393bf8b72be144edf0a04bde1b89c77a388cb112bb530db02 not found: ID does not exist"
Sep 06 01:11:49.353017 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.352975    2582 scope.go:117] "RemoveContainer" containerID="4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"
Sep 06 01:11:49.353227 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.353211    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387"} err="failed to get container status \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": rpc error: code = NotFound desc = could not find container \"4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387\": container with ID starting with 4d454f067c52eb394f96ce89bd2f169f5dfde993ff4e45cf05d1ac3947beb387 not found: ID does not exist"
Sep 06 01:11:49.353227 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.353226    2582 scope.go:117] "RemoveContainer" containerID="39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"
Sep 06 01:11:49.353447 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.353428    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000"} err="failed to get container status \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": rpc error: code = NotFound desc = could not find container \"39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000\": container with ID starting with 39aba3e44b48566388f4f0321b14e8213976ed8041cb0584e5fa8f58728aa000 not found: ID does not exist"
Sep 06 01:11:49.353490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.353448    2582 scope.go:117] "RemoveContainer" containerID="1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"
Sep 06 01:11:49.353684 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.353662    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8"} err="failed to get container status \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": rpc error: code = NotFound desc = could not find container \"1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8\": container with ID starting with 1e05b9bccb0aeb0c869d1a52ec9c0dd5655fcf6a94930f6614917f016c03a2f8 not found: ID does not exist"
Sep 06 01:11:49.377285 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377380 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377380 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377380 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377381    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377672 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377672 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377672 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377759    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prv5f\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-kube-api-access-prv5f\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.377826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.378059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.378059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377876    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.378059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.378059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.378059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.377982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.478990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.478905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.478990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.478960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.478990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.478982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479209    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.479287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prv5f\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-kube-api-access-prv5f\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.479740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.480347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480793 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.480768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.480930 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.480912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.481576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.481388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.482096 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.482041    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.482638 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.482609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.483025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.482984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.483373 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.483349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.483645 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.483617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.483955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.483931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.484400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.484365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.484491 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.484464    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.484816 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.484796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.485088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.485072    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.485437 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.485417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74672651-9951-4c61-bdb9-482b3e5ee1fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.485477 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.485433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74672651-9951-4c61-bdb9-482b3e5ee1fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.485622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.485608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74672651-9951-4c61-bdb9-482b3e5ee1fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.487853 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.487832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prv5f\" (UniqueName: \"kubernetes.io/projected/74672651-9951-4c61-bdb9-482b3e5ee1fa-kube-api-access-prv5f\") pod \"prometheus-k8s-0\" (UID: \"74672651-9951-4c61-bdb9-482b3e5ee1fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.649952 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.649903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:49.930931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:49.930907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 06 01:11:49.932884 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:11:49.932860    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74672651_9951_4c61_bdb9_482b3e5ee1fa.slice/crio-7edbbd2b63720e5b4472073e6b60f0f9c95eb6d953446d5cca63920e1cf2feca WatchSource:0}: Error finding container 7edbbd2b63720e5b4472073e6b60f0f9c95eb6d953446d5cca63920e1cf2feca: Status 404 returned error can't find the container with id 7edbbd2b63720e5b4472073e6b60f0f9c95eb6d953446d5cca63920e1cf2feca
Sep 06 01:11:50.279238 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:50.279126    2582 generic.go:356] "Generic (PLEG): container finished" podID="74672651-9951-4c61-bdb9-482b3e5ee1fa" containerID="24aed7e00ad8eb489522eee199274176dc2b23db62a305e54cbbc053bfa89a60" exitCode=0
Sep 06 01:11:50.279238 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:50.279215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerDied","Data":"24aed7e00ad8eb489522eee199274176dc2b23db62a305e54cbbc053bfa89a60"}
Sep 06 01:11:50.279444 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:50.279290    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"7edbbd2b63720e5b4472073e6b60f0f9c95eb6d953446d5cca63920e1cf2feca"}
Sep 06 01:11:50.490630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:50.490469    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a012b10-dd87-4d71-923a-91dff3282f69" path="/var/lib/kubelet/pods/8a012b10-dd87-4d71-923a-91dff3282f69/volumes"
Sep 06 01:11:51.287015 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.286927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"a687497329559bf4998da9b1ab7217222924531afe324c5a97ee7ab50c38816f"}
Sep 06 01:11:51.287388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.287047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"ab2e6316d04d7a8009c6c962cab93cf138cd7ceb4c6b3a35a4223a48c7cd20a8"}
Sep 06 01:11:51.287388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.287090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"16e437a92b43759d572427ca22c9536243720efd2b2ff92c846a1f9581d8aaca"}
Sep 06 01:11:51.287388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.287127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"5da7756adee2757999ae766dc4f826583bfb5c1535433293c91b4c4e5412754a"}
Sep 06 01:11:51.287388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.287162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"88acc6f22b8376c233e8dca915986df3988059ccbd332a891e5bae045a25bac0"}
Sep 06 01:11:51.287388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.287232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74672651-9951-4c61-bdb9-482b3e5ee1fa","Type":"ContainerStarted","Data":"baa14787221ed3f68dda8d9efd31f2f4275f86515c2f008ae38d422dee61d831"}
Sep 06 01:11:51.319557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:51.319505    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.298515591 podStartE2EDuration="2.31948933s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.973739ms" isStatefulPod=false podCreationTimestamp="2026-09-06 01:11:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:51.317164775 +0000 UTC m=+141.319646364" watchObservedRunningTime="2026-09-06 01:11:51.31948933 +0000 UTC m=+141.321970896"
Sep 06 01:11:52.288626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:52.288581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:52.343638 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:52.343604    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:54.650782 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:54.650735    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:11:55.701791 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:55.701753    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:55.702277 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:55.701890    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:55.706524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:55.706504    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:56.310688 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.310658    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:11:56.363255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.363224    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:11:56.452371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.452329    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:56.506131 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.506094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:56.562006 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.561930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:56.703424 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.703382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:11:56.807576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:11:56.807540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:21.383865 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.383757    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77f5656c8d-9hmsl" podUID="708ff289-8332-4fb9-ada0-3301c749c0c1" containerName="console" containerID="cri-o://dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d" gracePeriod=15
Sep 06 01:12:21.626619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.626594    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:12:21.759371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759335    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759357    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759383    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759421    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759610    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgjbx\" (UniqueName: \"kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759686    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca\") pod \"708ff289-8332-4fb9-ada0-3301c749c0c1\" (UID: \"708ff289-8332-4fb9-ada0-3301c749c0c1\") "
Sep 06 01:12:21.759814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config" (OuterVolumeSpecName: "console-config") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:21.760018 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.759975    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.760149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.760058    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:21.760253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.760148    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:21.760253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.760232    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:12:21.761720 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.761693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:12:21.762252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.762232    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:12:21.762339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.762276    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx" (OuterVolumeSpecName: "kube-api-access-xgjbx") pod "708ff289-8332-4fb9-ada0-3301c749c0c1" (UID: "708ff289-8332-4fb9-ada0-3301c749c0c1"). InnerVolumeSpecName "kube-api-access-xgjbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:12:21.860371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860338    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.860371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860371    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgjbx\" (UniqueName: \"kubernetes.io/projected/708ff289-8332-4fb9-ada0-3301c749c0c1-kube-api-access-xgjbx\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.860523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860383    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.860523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860392    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.860523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860400    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ff289-8332-4fb9-ada0-3301c749c0c1-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:21.860523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:21.860409    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ff289-8332-4fb9-ada0-3301c749c0c1-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:12:22.417587 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.417552    2582 generic.go:356] "Generic (PLEG): container finished" podID="708ff289-8332-4fb9-ada0-3301c749c0c1" containerID="dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d" exitCode=0
Sep 06 01:12:22.418121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.417601    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77f5656c8d-9hmsl"
Sep 06 01:12:22.418121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.417642    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f5656c8d-9hmsl" event={"ID":"708ff289-8332-4fb9-ada0-3301c749c0c1","Type":"ContainerDied","Data":"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"}
Sep 06 01:12:22.418121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.417711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77f5656c8d-9hmsl" event={"ID":"708ff289-8332-4fb9-ada0-3301c749c0c1","Type":"ContainerDied","Data":"f1b110ca45dd42dd0c9855dfa519261b9f60ff3379fff038ad622c79844b8c3d"}
Sep 06 01:12:22.418121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.417730    2582 scope.go:117] "RemoveContainer" containerID="dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"
Sep 06 01:12:22.426151 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.426137    2582 scope.go:117] "RemoveContainer" containerID="dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"
Sep 06 01:12:22.426451 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:12:22.426433    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d\": container with ID starting with dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d not found: ID does not exist" containerID="dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"
Sep 06 01:12:22.426528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.426457    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d"} err="failed to get container status \"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d\": rpc error: code = NotFound desc = could not find container \"dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d\": container with ID starting with dcbe2edcb1fccd0cc3721f1efd4928a320179e9c6333590b19eb33d4a73eea9d not found: ID does not exist"
Sep 06 01:12:22.437511 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.437486    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:12:22.441584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.441562    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77f5656c8d-9hmsl"]
Sep 06 01:12:22.475353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:22.475328    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="708ff289-8332-4fb9-ada0-3301c749c0c1" path="/var/lib/kubelet/pods/708ff289-8332-4fb9-ada0-3301c749c0c1/volumes"
Sep 06 01:12:34.595865 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:34.595828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:39.699931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:39.699894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:39.751665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:39.751634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:40.980165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:40.980133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:41.081079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:41.081045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:12:49.650250 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:49.650223    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:12:49.666058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:49.666034    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:12:50.534975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:12:50.534948    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 06 01:13:02.881340 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:02.881305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:04.228737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:04.228705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:06.492701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:06.492665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:06.544720 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:06.544689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:07.896775 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:07.896745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:07.996464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:07.996432    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:08.593587 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:08.593554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:08.720908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:08.720873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:10.099850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.099812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:10.307996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.307962    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:10.668721 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.668691    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"]
Sep 06 01:13:10.669004 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.668992    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708ff289-8332-4fb9-ada0-3301c749c0c1" containerName="console"
Sep 06 01:13:10.669055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.669007    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="708ff289-8332-4fb9-ada0-3301c749c0c1" containerName="console"
Sep 06 01:13:10.669088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.669067    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="708ff289-8332-4fb9-ada0-3301c749c0c1" containerName="console"
Sep 06 01:13:10.670914 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.670900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.673481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.673455    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 01:13:10.673481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.673462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xztmr\""
Sep 06 01:13:10.674355 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.674338    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 01:13:10.681482 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.681463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"]
Sep 06 01:13:10.754242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.754205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.754399 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.754254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkgx\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-kube-api-access-txkgx\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.855540 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.855502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.855540 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.855544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkgx\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-kube-api-access-txkgx\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.863703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.863668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.863831 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.863770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkgx\" (UniqueName: \"kubernetes.io/projected/61163869-cd71-4011-af12-b2c0eacb5637-kube-api-access-txkgx\") pod \"cert-manager-cainjector-559cdd8c87-c96xv\" (UID: \"61163869-cd71-4011-af12-b2c0eacb5637\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:10.985696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:10.985616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"
Sep 06 01:13:11.254107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:11.254027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-c96xv"]
Sep 06 01:13:11.257837 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:13:11.257812    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61163869_cd71_4011_af12_b2c0eacb5637.slice/crio-c11000403cabcaeb6ef686bd8a38e5d38a3a37d3842621bd8c24775e9e4456c9 WatchSource:0}: Error finding container c11000403cabcaeb6ef686bd8a38e5d38a3a37d3842621bd8c24775e9e4456c9: Status 404 returned error can't find the container with id c11000403cabcaeb6ef686bd8a38e5d38a3a37d3842621bd8c24775e9e4456c9
Sep 06 01:13:11.600004 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:11.599922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv" event={"ID":"61163869-cd71-4011-af12-b2c0eacb5637","Type":"ContainerStarted","Data":"c11000403cabcaeb6ef686bd8a38e5d38a3a37d3842621bd8c24775e9e4456c9"}
Sep 06 01:13:13.486052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:13.486012    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:13.544397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:13.544354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:14.614280 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:14.614161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv" event={"ID":"61163869-cd71-4011-af12-b2c0eacb5637","Type":"ContainerStarted","Data":"e7f55997779eab573de05e83c82472898175cbe6a5ae06131ce2b1a65f028636"}
Sep 06 01:13:14.653929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:14.653870    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-c96xv" podStartSLOduration=1.739122512 podStartE2EDuration="4.653851787s" totalImagesPullingTime="2.914729275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:14.651481557 +0000 UTC m=+224.653963127" watchObservedRunningTime="2026-09-06 01:13:14.653851787 +0000 UTC m=+224.656333353"
Sep 06 01:13:16.091233 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:16.091135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:16.145044 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:16.145010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:18.115344 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:18.115311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:19.299412 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:19.299367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:19.364295 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:19.364265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:21.317064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.317026    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"]
Sep 06 01:13:21.320145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.320125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.322683 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.322653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:13:21.322804 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.322744    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 01:13:21.323758 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.323743    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k462x\""
Sep 06 01:13:21.328630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.328606    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"]
Sep 06 01:13:21.442271 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.442240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvht4\" (UniqueName: \"kubernetes.io/projected/23a68635-7758-436e-b282-67bd26f32eb2-kube-api-access-qvht4\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.442427 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.442288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a68635-7758-436e-b282-67bd26f32eb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.543585 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.543545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a68635-7758-436e-b282-67bd26f32eb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.543727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.543630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvht4\" (UniqueName: \"kubernetes.io/projected/23a68635-7758-436e-b282-67bd26f32eb2-kube-api-access-qvht4\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.543923 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.543906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a68635-7758-436e-b282-67bd26f32eb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.552261 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.552239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvht4\" (UniqueName: \"kubernetes.io/projected/23a68635-7758-436e-b282-67bd26f32eb2-kube-api-access-qvht4\") pod \"openshift-lws-operator-fd8ccff4c-xstj6\" (UID: \"23a68635-7758-436e-b282-67bd26f32eb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.629218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.629163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"
Sep 06 01:13:21.900676 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:21.900589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6"]
Sep 06 01:13:21.904288 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:13:21.904248    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a68635_7758_436e_b282_67bd26f32eb2.slice/crio-4679e6e7c8a324ade0965e6da1708dcd60a2ed6868bad0c42e16d0ab490fb92a WatchSource:0}: Error finding container 4679e6e7c8a324ade0965e6da1708dcd60a2ed6868bad0c42e16d0ab490fb92a: Status 404 returned error can't find the container with id 4679e6e7c8a324ade0965e6da1708dcd60a2ed6868bad0c42e16d0ab490fb92a
Sep 06 01:13:22.645783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:22.645751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6" event={"ID":"23a68635-7758-436e-b282-67bd26f32eb2","Type":"ContainerStarted","Data":"4679e6e7c8a324ade0965e6da1708dcd60a2ed6868bad0c42e16d0ab490fb92a"}
Sep 06 01:13:25.659718 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:25.659681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6" event={"ID":"23a68635-7758-436e-b282-67bd26f32eb2","Type":"ContainerStarted","Data":"1dbe393d74ee68da5783f4180a647f5adb02cf0185e894e323d0c96ee908d749"}
Sep 06 01:13:25.677368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:25.677320    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xstj6" podStartSLOduration=1.891897505 podStartE2EDuration="4.677304598s" totalImagesPullingTime="2.785407093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:25.676665089 +0000 UTC m=+235.679146656" watchObservedRunningTime="2026-09-06 01:13:25.677304598 +0000 UTC m=+235.679786164"
Sep 06 01:13:26.365039 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:26.365001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:26.466155 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:26.466119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:28.368463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:28.368433    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:38.657478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.657447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:38.724660 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.724627    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"]
Sep 06 01:13:38.730678 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.730660    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.733607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.733574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 06 01:13:38.734399 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.734371    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 06 01:13:38.734399 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.734382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 06 01:13:38.734531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.734426    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jv294\""
Sep 06 01:13:38.740298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.740274    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"]
Sep 06 01:13:38.762304 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.762281    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:38.784409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.784385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-manager-config\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.784537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.784448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjkfc\" (UniqueName: \"kubernetes.io/projected/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-kube-api-access-cjkfc\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.784537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.784471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.784537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.784488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.885138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.885105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-manager-config\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.885351 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.885201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjkfc\" (UniqueName: \"kubernetes.io/projected/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-kube-api-access-cjkfc\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.885351 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.885228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.885351 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.885254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.885848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.885826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-manager-config\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.887815 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.887796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-metrics-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.887895 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.887838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-cert\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:38.894018 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:38.893996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjkfc\" (UniqueName: \"kubernetes.io/projected/2e5568c9-37c7-4cf6-aeaa-d8031e9484ba-kube-api-access-cjkfc\") pod \"lws-controller-manager-68cb9d866d-b4k82\" (UID: \"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba\") " pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:39.041665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:39.041573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:39.338473 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:39.338429    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"]
Sep 06 01:13:39.339684 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:13:39.339659    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5568c9_37c7_4cf6_aeaa_d8031e9484ba.slice/crio-a87b74be630c9a6a9090583d0b1b5f68d493ff39cadb1d206ce10058f1ff3839 WatchSource:0}: Error finding container a87b74be630c9a6a9090583d0b1b5f68d493ff39cadb1d206ce10058f1ff3839: Status 404 returned error can't find the container with id a87b74be630c9a6a9090583d0b1b5f68d493ff39cadb1d206ce10058f1ff3839
Sep 06 01:13:39.598709 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:39.598627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:39.698548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:39.698517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:39.716063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:39.716034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82" event={"ID":"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba","Type":"ContainerStarted","Data":"a87b74be630c9a6a9090583d0b1b5f68d493ff39cadb1d206ce10058f1ff3839"}
Sep 06 01:13:40.227212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.227144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.503878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.503787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.612119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.612082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.637323 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.637268    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"]
Sep 06 01:13:40.641366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.641344    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.644108 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.644087    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rcbr\""
Sep 06 01:13:40.644262 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.644138    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 01:13:40.644262 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.644140    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 01:13:40.644450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.644412    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 01:13:40.644559 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.644468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 01:13:40.656937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.656916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"]
Sep 06 01:13:40.700546 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.700514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.700977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.700555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxf57\" (UniqueName: \"kubernetes.io/projected/3b6d0697-080b-45af-95a4-4f5edf002c18-kube-api-access-hxf57\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.700977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.700654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.700977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.700683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.700977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.700704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.745468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.745431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.801626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.801543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.801626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.801581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.801626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.801599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.801896 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.801654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.801896 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.801680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxf57\" (UniqueName: \"kubernetes.io/projected/3b6d0697-080b-45af-95a4-4f5edf002c18-kube-api-access-hxf57\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.802052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.802029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.804076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.804050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b6d0697-080b-45af-95a4-4f5edf002c18-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.804222 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.804123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.804222 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.804209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b6d0697-080b-45af-95a4-4f5edf002c18-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.808851 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.808829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxf57\" (UniqueName: \"kubernetes.io/projected/3b6d0697-080b-45af-95a4-4f5edf002c18-kube-api-access-hxf57\") pod \"opendatahub-operator-controller-manager-bb49d79fd-tmb6t\" (UID: \"3b6d0697-080b-45af-95a4-4f5edf002c18\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:40.846170 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.846143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.947692 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.947664    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:40.956247 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:40.956220    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:41.063478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.063404    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:41.161119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.161088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:41.238404 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.238384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"]
Sep 06 01:13:41.240608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.240587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:41.241101 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:13:41.241080    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6d0697_080b_45af_95a4_4f5edf002c18.slice/crio-a1ffc4199ddd25d63e141006c5c75088d621f2571475e643b577cfd4d68bb375 WatchSource:0}: Error finding container a1ffc4199ddd25d63e141006c5c75088d621f2571475e643b577cfd4d68bb375: Status 404 returned error can't find the container with id a1ffc4199ddd25d63e141006c5c75088d621f2571475e643b577cfd4d68bb375
Sep 06 01:13:41.725842 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.725798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82" event={"ID":"2e5568c9-37c7-4cf6-aeaa-d8031e9484ba","Type":"ContainerStarted","Data":"2c7d5626f274b054cc8ac454ce94eae82f9643f1e9ba2d2af6e4f9515500f36d"}
Sep 06 01:13:41.726309 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.725859    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:41.727089 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.727067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t" event={"ID":"3b6d0697-080b-45af-95a4-4f5edf002c18","Type":"ContainerStarted","Data":"a1ffc4199ddd25d63e141006c5c75088d621f2571475e643b577cfd4d68bb375"}
Sep 06 01:13:41.747964 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:41.747907    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82" podStartSLOduration=2.232640085 podStartE2EDuration="3.747891243s" totalImagesPullingTime="1.515251158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:41.74575259 +0000 UTC m=+251.748234168" watchObservedRunningTime="2026-09-06 01:13:41.747891243 +0000 UTC m=+251.750372808"
Sep 06 01:13:44.744765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:44.744731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t" event={"ID":"3b6d0697-080b-45af-95a4-4f5edf002c18","Type":"ContainerStarted","Data":"3dab1ce38ca50db9c5c73b062e2386a3ad9ddce594bab93cf4c610983d2296b4"}
Sep 06 01:13:45.750499 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:45.750465    2582 generic.go:356] "Generic (PLEG): container finished" podID="3b6d0697-080b-45af-95a4-4f5edf002c18" containerID="3dab1ce38ca50db9c5c73b062e2386a3ad9ddce594bab93cf4c610983d2296b4" exitCode=0
Sep 06 01:13:45.750902 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:45.750557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t" event={"ID":"3b6d0697-080b-45af-95a4-4f5edf002c18","Type":"ContainerDied","Data":"3dab1ce38ca50db9c5c73b062e2386a3ad9ddce594bab93cf4c610983d2296b4"}
Sep 06 01:13:46.756866 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:46.756834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t" event={"ID":"3b6d0697-080b-45af-95a4-4f5edf002c18","Type":"ContainerStarted","Data":"f05bae4af270fcae761fecf59bd2a0469fe80edcd9416e65e60b9adb968deabf"}
Sep 06 01:13:46.757336 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:46.756970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:52.735527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:52.735457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68cb9d866d-b4k82"
Sep 06 01:13:52.753867 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:52.753820    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t" podStartSLOduration=8.069001997 podStartE2EDuration="12.753804199s" totalImagesPullingTime="3.608448514s" totalInitContainerRuntime="1.076353688s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:46.790537121 +0000 UTC m=+256.793018739" watchObservedRunningTime="2026-09-06 01:13:52.753804199 +0000 UTC m=+262.756285787"
Sep 06 01:13:57.763140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:57.763107    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-tmb6t"
Sep 06 01:13:59.304034 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:59.303996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:13:59.471541 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:13:59.471509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:02.452943 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.452901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:02.495836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.495802    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"]
Sep 06 01:14:02.498076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.498058    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.500836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.500815    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 01:14:02.500996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.500979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lhc5j\""
Sep 06 01:14:02.502612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.502591    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 01:14:02.502708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.502614    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 01:14:02.502708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.502660    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 01:14:02.511422 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.511402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"]
Sep 06 01:14:02.584138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.584109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ef8b49-166a-4847-9d53-a0864eb7a264-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.584303 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.584143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27ef8b49-166a-4847-9d53-a0864eb7a264-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.584303 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.584173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cprkq\" (UniqueName: \"kubernetes.io/projected/27ef8b49-166a-4847-9d53-a0864eb7a264-kube-api-access-cprkq\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.665840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.665807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:02.684998 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.684973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27ef8b49-166a-4847-9d53-a0864eb7a264-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.685137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.685025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cprkq\" (UniqueName: \"kubernetes.io/projected/27ef8b49-166a-4847-9d53-a0864eb7a264-kube-api-access-cprkq\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.685137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.685110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ef8b49-166a-4847-9d53-a0864eb7a264-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.687401 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.687382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27ef8b49-166a-4847-9d53-a0864eb7a264-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.687637 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.687618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27ef8b49-166a-4847-9d53-a0864eb7a264-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.692629 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.692605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cprkq\" (UniqueName: \"kubernetes.io/projected/27ef8b49-166a-4847-9d53-a0864eb7a264-kube-api-access-cprkq\") pod \"kube-auth-proxy-7cfcd8dfd7-tp8df\" (UID: \"27ef8b49-166a-4847-9d53-a0864eb7a264\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:02.807624 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:02.807558    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"
Sep 06 01:14:03.075954 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:03.075931    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df"]
Sep 06 01:14:03.078750 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:14:03.078725    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ef8b49_166a_4847_9d53_a0864eb7a264.slice/crio-33359acc949a866487f2012f61538498c0cc8d7999dc715e63f170d8550565b4 WatchSource:0}: Error finding container 33359acc949a866487f2012f61538498c0cc8d7999dc715e63f170d8550565b4: Status 404 returned error can't find the container with id 33359acc949a866487f2012f61538498c0cc8d7999dc715e63f170d8550565b4
Sep 06 01:14:03.627071 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:03.627025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:03.688436 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:03.688390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:03.832733 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:03.832694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df" event={"ID":"27ef8b49-166a-4847-9d53-a0864eb7a264","Type":"ContainerStarted","Data":"33359acc949a866487f2012f61538498c0cc8d7999dc715e63f170d8550565b4"}
Sep 06 01:14:04.568914 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:04.568877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:05.844134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:05.844101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df" event={"ID":"27ef8b49-166a-4847-9d53-a0864eb7a264","Type":"ContainerStarted","Data":"c687857478530ca714ce82f0be542189db3c5308a706b81dad671d3acb611da6"}
Sep 06 01:14:05.861864 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:05.861820    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-tp8df" podStartSLOduration=1.221564372 podStartE2EDuration="3.861806294s" totalImagesPullingTime="2.640241922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:05.860858419 +0000 UTC m=+275.863339986" watchObservedRunningTime="2026-09-06 01:14:05.861806294 +0000 UTC m=+275.864287856"
Sep 06 01:14:08.547087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:08.547056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:08.649433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:08.649405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:08.828719 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:08.828639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:10.225316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:10.225282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:10.325157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:10.325126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:10.458995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:10.458964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:10.548800 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:10.548720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:11.415599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:11.415562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:21.075527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.075489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:21.225330 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.225289    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"]
Sep 06 01:14:21.228078 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.228063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.231230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.231211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8fblw\""
Sep 06 01:14:21.236414 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.236388    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 06 01:14:21.255725 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.255700    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"]
Sep 06 01:14:21.265867 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.265838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:21.350495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.350405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpl2m\" (UniqueName: \"kubernetes.io/projected/d659c78d-f83a-4289-8154-13a21cd00a3c-kube-api-access-rpl2m\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.350495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.350463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659c78d-f83a-4289-8154-13a21cd00a3c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.397929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.397904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:21.451603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.451576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659c78d-f83a-4289-8154-13a21cd00a3c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.451716 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.451654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpl2m\" (UniqueName: \"kubernetes.io/projected/d659c78d-f83a-4289-8154-13a21cd00a3c-kube-api-access-rpl2m\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.454265 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.454242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d659c78d-f83a-4289-8154-13a21cd00a3c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.460631 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.460610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpl2m\" (UniqueName: \"kubernetes.io/projected/d659c78d-f83a-4289-8154-13a21cd00a3c-kube-api-access-rpl2m\") pod \"llmisvc-controller-manager-777c6bd7d5-lvmtj\" (UID: \"d659c78d-f83a-4289-8154-13a21cd00a3c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.498706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.498686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:21.537696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.537676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:21.808088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.808064    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"]
Sep 06 01:14:21.810575 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:14:21.810546    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd659c78d_f83a_4289_8154_13a21cd00a3c.slice/crio-89d8f13e4db6b0f7df8d69fd02e9534e772eb1af12b1f6118a05f4622c580e31 WatchSource:0}: Error finding container 89d8f13e4db6b0f7df8d69fd02e9534e772eb1af12b1f6118a05f4622c580e31: Status 404 returned error can't find the container with id 89d8f13e4db6b0f7df8d69fd02e9534e772eb1af12b1f6118a05f4622c580e31
Sep 06 01:14:21.921605 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:21.921566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj" event={"ID":"d659c78d-f83a-4289-8154-13a21cd00a3c","Type":"ContainerStarted","Data":"89d8f13e4db6b0f7df8d69fd02e9534e772eb1af12b1f6118a05f4622c580e31"}
Sep 06 01:14:22.436061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:22.436021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:22.534741 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:22.534687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:22.634927 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:22.634867    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:24.938014 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:24.937977    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj" event={"ID":"d659c78d-f83a-4289-8154-13a21cd00a3c","Type":"ContainerStarted","Data":"e750812c657ea6102aadb9dac5165ffe3e2901ec4939176d5e9b0e926d2af752"}
Sep 06 01:14:24.938421 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:24.938101    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:24.957038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:24.956991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj" podStartSLOduration=1.528632842 podStartE2EDuration="3.956977894s" totalImagesPullingTime="2.428345052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:24.955852469 +0000 UTC m=+294.958334035" watchObservedRunningTime="2026-09-06 01:14:24.956977894 +0000 UTC m=+294.959459460"
Sep 06 01:14:30.404356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:30.404329    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:14:30.404811 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:30.404793    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:14:30.407599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:30.407583    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 01:14:47.379985 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:47.379948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:47.477432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:47.477403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:55.944480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:55.944450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-lvmtj"
Sep 06 01:14:58.598400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:58.598364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:14:58.699055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:14:58.698991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:11.374138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:11.374104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:11.461609 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:11.461580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:15.061224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.061188    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd7cdb44f-qh2nv"]
Sep 06 01:15:15.068879 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.068854    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.077340 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.077318    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd7cdb44f-qh2nv"]
Sep 06 01:15:15.124838 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.124812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:15.193761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-oauth-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.193884 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-oauth-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.193884 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wthf\" (UniqueName: \"kubernetes.io/projected/5bc010c4-621d-465a-866e-917f767298be-kube-api-access-8wthf\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.193884 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-console-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.193987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-service-ca\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.193987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.193913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-trusted-ca-bundle\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.198205 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.194376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.220904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.220869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:15.295101 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-oauth-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wthf\" (UniqueName: \"kubernetes.io/projected/5bc010c4-621d-465a-866e-917f767298be-kube-api-access-8wthf\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-console-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-service-ca\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-trusted-ca-bundle\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-oauth-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.295950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-console-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.296054 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.295929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-service-ca\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.296169 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.296149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-trusted-ca-bundle\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.296336 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.296316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bc010c4-621d-465a-866e-917f767298be-oauth-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.297851 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.297822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-oauth-config\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.297923 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.297904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bc010c4-621d-465a-866e-917f767298be-console-serving-cert\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.303421 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.303399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wthf\" (UniqueName: \"kubernetes.io/projected/5bc010c4-621d-465a-866e-917f767298be-kube-api-access-8wthf\") pod \"console-bd7cdb44f-qh2nv\" (UID: \"5bc010c4-621d-465a-866e-917f767298be\") " pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.315433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.315379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:15.379682 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.379659    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:15.651056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.651034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd7cdb44f-qh2nv"]
Sep 06 01:15:15.653847 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:15:15.653816    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc010c4_621d_465a_866e_917f767298be.slice/crio-f392752ad796a474e81a893b6eabbe35e90fb667881ec0b295c596005e187944 WatchSource:0}: Error finding container f392752ad796a474e81a893b6eabbe35e90fb667881ec0b295c596005e187944: Status 404 returned error can't find the container with id f392752ad796a474e81a893b6eabbe35e90fb667881ec0b295c596005e187944
Sep 06 01:15:15.857830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.857798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:15.940505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:15.940438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:16.162579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:16.162546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cdb44f-qh2nv" event={"ID":"5bc010c4-621d-465a-866e-917f767298be","Type":"ContainerStarted","Data":"bdb162a386dda7f305dc3dec7ece5e931cf4420cf0f707c4ba1a7adf3c2f3552"}
Sep 06 01:15:16.162983 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:16.162590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd7cdb44f-qh2nv" event={"ID":"5bc010c4-621d-465a-866e-917f767298be","Type":"ContainerStarted","Data":"f392752ad796a474e81a893b6eabbe35e90fb667881ec0b295c596005e187944"}
Sep 06 01:15:16.181750 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:16.181707    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd7cdb44f-qh2nv" podStartSLOduration=1.181692474 podStartE2EDuration="1.181692474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:16.180206668 +0000 UTC m=+346.182688227" watchObservedRunningTime="2026-09-06 01:15:16.181692474 +0000 UTC m=+346.184174053"
Sep 06 01:15:25.125432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:25.125357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:25.380449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:25.380367    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:25.380449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:25.380422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:25.385196 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:25.385160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:26.212661 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:26.212634    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd7cdb44f-qh2nv"
Sep 06 01:15:26.258386 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:26.258354    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:15:26.354323 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:26.354282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:26.455640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:26.455609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:26.556576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:26.556506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:27.713848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:27.713816    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:28.126382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:28.126352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:28.538446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:28.538371    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:29.755583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:29.755553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:31.604167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:31.604133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:31.693418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:31.693388    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:32.131959 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:32.131921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:33.727578 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:33.727543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:34.119870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:34.119839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:34.412517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:34.412438    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:36.556752 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:36.556720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:37.865905 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:37.865872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:37.952977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:37.952948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:39.675669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:39.675643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:39.922714 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:39.922688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:42.719129 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:42.719094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:42.819729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:42.819697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:42.920598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:42.920566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:42.988633 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:42.988568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:43.920220 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:43.920164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:43.977757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:43.977718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:49.406947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.406910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:49.514245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.514215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:49.879987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.879953    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"]
Sep 06 01:15:49.883728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.883708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:49.887365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.887346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fnp5\""
Sep 06 01:15:49.887515 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.887347    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 01:15:49.887739 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.887725    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 01:15:49.898607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.898589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"]
Sep 06 01:15:49.990966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.990932    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:49.991103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:49.990972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcx4j\" (UniqueName: \"kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.091724 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.091693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.091873 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.091730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcx4j\" (UniqueName: \"kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.092225 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.092208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.100143 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.100119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcx4j\" (UniqueName: \"kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j\") pod \"kuadrant-operator-controller-manager-68cf589589-s59fp\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.160857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.160785    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"]
Sep 06 01:15:50.161418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.161396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:50.163571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.163532    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"]
Sep 06 01:15:50.190605 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.190577    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:15:50.194403 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.194384    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.209325 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.209266    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:15:50.293411 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.293371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.293606 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.293420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt4mf\" (UniqueName: \"kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.394162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.394123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.394392 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.394214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt4mf\" (UniqueName: \"kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.394548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.394527    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.404555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.404533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt4mf\" (UniqueName: \"kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf\") pod \"kuadrant-operator-controller-manager-68cf589589-2xnqk\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.506123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.506040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:50.788980 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.788955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:15:50.791940 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:15:50.791919    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f028f98_8853_4e45_b418_3e1a74c9d76d.slice/crio-c5c5b2d8dd7ee9a905d6b5f1ff3eaf872d8b7ec490312dc1ebbaca60b30de6da WatchSource:0}: Error finding container c5c5b2d8dd7ee9a905d6b5f1ff3eaf872d8b7ec490312dc1ebbaca60b30de6da: Status 404 returned error can't find the container with id c5c5b2d8dd7ee9a905d6b5f1ff3eaf872d8b7ec490312dc1ebbaca60b30de6da
Sep 06 01:15:50.794672 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:50.794656    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:15:51.280498 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.280452    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76cb7d7db9-8426m" podUID="5775a9b1-8f4b-4148-91b9-4f6726951ded" containerName="console" containerID="cri-o://beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2" gracePeriod=15
Sep 06 01:15:51.330342 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.330313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" event={"ID":"9f028f98-8853-4e45-b418-3e1a74c9d76d","Type":"ContainerStarted","Data":"c5c5b2d8dd7ee9a905d6b5f1ff3eaf872d8b7ec490312dc1ebbaca60b30de6da"}
Sep 06 01:15:51.523852 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.523828    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:15:51.604147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604074    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604207    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604248    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604263    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604370    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkll2\" (UniqueName: \"kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2\") pod \"5775a9b1-8f4b-4148-91b9-4f6726951ded\" (UID: \"5775a9b1-8f4b-4148-91b9-4f6726951ded\") "
Sep 06 01:15:51.604713 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604685    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:51.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca" (OuterVolumeSpecName: "service-ca") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:51.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604759    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config" (OuterVolumeSpecName: "console-config") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:51.604874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.604801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:15:51.607016 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.606990    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:15:51.607263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.607241    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:15:51.607425 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.607403    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2" (OuterVolumeSpecName: "kube-api-access-kkll2") pod "5775a9b1-8f4b-4148-91b9-4f6726951ded" (UID: "5775a9b1-8f4b-4148-91b9-4f6726951ded"). InnerVolumeSpecName "kube-api-access-kkll2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705572    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-oauth-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705605    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705619    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705633    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-trusted-ca-bundle\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705646    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-console-config\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705658    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5775a9b1-8f4b-4148-91b9-4f6726951ded-oauth-serving-cert\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.705667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:51.705670    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkll2\" (UniqueName: \"kubernetes.io/projected/5775a9b1-8f4b-4148-91b9-4f6726951ded-kube-api-access-kkll2\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:52.339576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.339535    2582 generic.go:356] "Generic (PLEG): container finished" podID="5775a9b1-8f4b-4148-91b9-4f6726951ded" containerID="beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2" exitCode=0
Sep 06 01:15:52.339765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.339591    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cb7d7db9-8426m"
Sep 06 01:15:52.339765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.339600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cb7d7db9-8426m" event={"ID":"5775a9b1-8f4b-4148-91b9-4f6726951ded","Type":"ContainerDied","Data":"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"}
Sep 06 01:15:52.339765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.339678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cb7d7db9-8426m" event={"ID":"5775a9b1-8f4b-4148-91b9-4f6726951ded","Type":"ContainerDied","Data":"3a61163ceff25d502acae03a6e489a23b757338b80bc220b96c1cd62d30518dc"}
Sep 06 01:15:52.339765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.339708    2582 scope.go:117] "RemoveContainer" containerID="beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"
Sep 06 01:15:52.354034 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.353945    2582 scope.go:117] "RemoveContainer" containerID="beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"
Sep 06 01:15:52.354340 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:52.354321    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2\": container with ID starting with beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2 not found: ID does not exist" containerID="beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"
Sep 06 01:15:52.354431 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.354352    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2"} err="failed to get container status \"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2\": rpc error: code = NotFound desc = could not find container \"beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2\": container with ID starting with beb1c861a33e084f945284c529fee9a57acc2d58557f10fc3db2532e0f6d35b2 not found: ID does not exist"
Sep 06 01:15:52.369703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.369658    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:15:52.375399 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.375376    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76cb7d7db9-8426m"]
Sep 06 01:15:52.481304 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:52.481264    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5775a9b1-8f4b-4148-91b9-4f6726951ded" path="/var/lib/kubelet/pods/5775a9b1-8f4b-4148-91b9-4f6726951ded/volumes"
Sep 06 01:15:53.254982 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:53.254940    2582 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-s59fp_kuadrant-system_6e371284-53fd-4291-93a9-b9efae175231_0(34eec0729085059530e401fe19abeab2abf89c458e6ce8d43114f6f1416cac45): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-s59fp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Sep 06 01:15:53.255604 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:53.255007    2582 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-68cf589589-s59fp_kuadrant-system_6e371284-53fd-4291-93a9-b9efae175231_0(34eec0729085059530e401fe19abeab2abf89c458e6ce8d43114f6f1416cac45): error adding pod kuadrant-system_kuadrant-operator-controller-manager-68cf589589-s59fp to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:53.347148 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.347113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:53.354650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.354626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:53.356900 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:53.356867    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-s59fp\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="6e371284-53fd-4291-93a9-b9efae175231" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:53.419286 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.419252    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume\") pod \"6e371284-53fd-4291-93a9-b9efae175231\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") "
Sep 06 01:15:53.419434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.419364    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcx4j\" (UniqueName: \"kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j\") pod \"6e371284-53fd-4291-93a9-b9efae175231\" (UID: \"6e371284-53fd-4291-93a9-b9efae175231\") "
Sep 06 01:15:53.419536 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.419512    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6e371284-53fd-4291-93a9-b9efae175231" (UID: "6e371284-53fd-4291-93a9-b9efae175231"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:53.421456 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.421436    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j" (OuterVolumeSpecName: "kube-api-access-mcx4j") pod "6e371284-53fd-4291-93a9-b9efae175231" (UID: "6e371284-53fd-4291-93a9-b9efae175231"). InnerVolumeSpecName "kube-api-access-mcx4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:53.520622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.520548    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcx4j\" (UniqueName: \"kubernetes.io/projected/6e371284-53fd-4291-93a9-b9efae175231-kube-api-access-mcx4j\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:53.520622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:53.520582    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e371284-53fd-4291-93a9-b9efae175231-extensions-socket-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:15:54.208836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:54.208804    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:54.308659 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:54.308623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:54.352378 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:54.352349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:54.354778 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:54.354740    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-s59fp\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="6e371284-53fd-4291-93a9-b9efae175231" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:54.361242 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:15:54.361211    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-s59fp\" is forbidden: User \"system:node:ip-10-0-132-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-205.ec2.internal' and this object" podUID="6e371284-53fd-4291-93a9-b9efae175231" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-s59fp"
Sep 06 01:15:54.479244 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:54.479140    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e371284-53fd-4291-93a9-b9efae175231" path="/var/lib/kubelet/pods/6e371284-53fd-4291-93a9-b9efae175231/volumes"
Sep 06 01:15:55.359043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:55.359000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" event={"ID":"9f028f98-8853-4e45-b418-3e1a74c9d76d","Type":"ContainerStarted","Data":"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"}
Sep 06 01:15:55.359443 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:55.359069    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:15:55.381108 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:55.381056    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" podStartSLOduration=1.025986282 podStartE2EDuration="5.381034796s" totalImagesPullingTime="4.355048514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:55.379501986 +0000 UTC m=+385.381983551" watchObservedRunningTime="2026-09-06 01:15:55.381034796 +0000 UTC m=+385.383516366"
Sep 06 01:15:56.755804 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:56.755773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:56.855567 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:56.855537    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:59.290239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:59.290205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:15:59.344715 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:15:59.344684    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:01.325494 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:01.325463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:01.426901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:01.426866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:01.526686 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:01.526659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:06.366354 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:06.366323    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:16:08.383810 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:08.383777    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:08.498022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:08.497990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:13.183403 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:13.183363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:13.284823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:13.284788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:15.800200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:15.800146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:15.901539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:15.901508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:19.353829 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.353795    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:16:19.354265 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.354022    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" podUID="9f028f98-8853-4e45-b418-3e1a74c9d76d" containerName="manager" containerID="cri-o://c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b" gracePeriod=10
Sep 06 01:16:19.603752 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.603727    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:16:19.647977 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.647953    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume\") pod \"9f028f98-8853-4e45-b418-3e1a74c9d76d\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") "
Sep 06 01:16:19.648112 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.648004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt4mf\" (UniqueName: \"kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf\") pod \"9f028f98-8853-4e45-b418-3e1a74c9d76d\" (UID: \"9f028f98-8853-4e45-b418-3e1a74c9d76d\") "
Sep 06 01:16:19.648391 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.648366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f028f98-8853-4e45-b418-3e1a74c9d76d" (UID: "9f028f98-8853-4e45-b418-3e1a74c9d76d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:19.650315 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.650292    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf" (OuterVolumeSpecName: "kube-api-access-mt4mf") pod "9f028f98-8853-4e45-b418-3e1a74c9d76d" (UID: "9f028f98-8853-4e45-b418-3e1a74c9d76d"). InnerVolumeSpecName "kube-api-access-mt4mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:19.748939 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.748911    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt4mf\" (UniqueName: \"kubernetes.io/projected/9f028f98-8853-4e45-b418-3e1a74c9d76d-kube-api-access-mt4mf\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:16:19.748939 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:19.748938    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f028f98-8853-4e45-b418-3e1a74c9d76d-extensions-socket-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:16:20.474945 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.474913    2582 generic.go:356] "Generic (PLEG): container finished" podID="9f028f98-8853-4e45-b418-3e1a74c9d76d" containerID="c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b" exitCode=0
Sep 06 01:16:20.475355 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.474975    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"
Sep 06 01:16:20.476600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.476575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" event={"ID":"9f028f98-8853-4e45-b418-3e1a74c9d76d","Type":"ContainerDied","Data":"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"}
Sep 06 01:16:20.476669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.476623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk" event={"ID":"9f028f98-8853-4e45-b418-3e1a74c9d76d","Type":"ContainerDied","Data":"c5c5b2d8dd7ee9a905d6b5f1ff3eaf872d8b7ec490312dc1ebbaca60b30de6da"}
Sep 06 01:16:20.476669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.476653    2582 scope.go:117] "RemoveContainer" containerID="c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"
Sep 06 01:16:20.485823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.485804    2582 scope.go:117] "RemoveContainer" containerID="c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"
Sep 06 01:16:20.486114 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:16:20.486093    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b\": container with ID starting with c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b not found: ID does not exist" containerID="c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"
Sep 06 01:16:20.486205 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.486122    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b"} err="failed to get container status \"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b\": rpc error: code = NotFound desc = could not find container \"c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b\": container with ID starting with c61a5e9010240ef49db23d4c8afc77d64e52e350f4656aaf8e8cef7393f7172b not found: ID does not exist"
Sep 06 01:16:20.504019 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.503998    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:16:20.508252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:20.508232    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-2xnqk"]
Sep 06 01:16:21.193522 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:21.193486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:21.249687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:21.249658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:21.586239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:21.586149    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:21.687189 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:21.687155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:21.997920 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:21.997884    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:22.065538 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:22.065492    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:22.476891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:22.476861    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f028f98-8853-4e45-b418-3e1a74c9d76d" path="/var/lib/kubelet/pods/9f028f98-8853-4e45-b418-3e1a74c9d76d/volumes"
Sep 06 01:16:22.717377 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:22.717349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:23.048371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:23.048338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:28.203497 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:28.203464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:28.305484 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:28.305446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:33.005253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:33.005215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:33.105055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:33.105013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:36.980962 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:36.980930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:37.093468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.093435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:37.176101 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.176062    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:37.180022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.179995    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:16:37.180407 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180393    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f028f98-8853-4e45-b418-3e1a74c9d76d" containerName="manager"
Sep 06 01:16:37.180468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180409    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f028f98-8853-4e45-b418-3e1a74c9d76d" containerName="manager"
Sep 06 01:16:37.180468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180422    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5775a9b1-8f4b-4148-91b9-4f6726951ded" containerName="console"
Sep 06 01:16:37.180468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180427    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5775a9b1-8f4b-4148-91b9-4f6726951ded" containerName="console"
Sep 06 01:16:37.180563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180508    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5775a9b1-8f4b-4148-91b9-4f6726951ded" containerName="console"
Sep 06 01:16:37.180563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.180515    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f028f98-8853-4e45-b418-3e1a74c9d76d" containerName="manager"
Sep 06 01:16:37.185889 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.185872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.188428 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.188405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s6xvj\""
Sep 06 01:16:37.188552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.188446    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 01:16:37.188552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.188489    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 01:16:37.189284 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.189267    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 01:16:37.191484 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.191464    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:16:37.217692 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.217663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:16:37.300989 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.300898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q6tr\" (UniqueName: \"kubernetes.io/projected/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-kube-api-access-8q6tr\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.300989 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.300965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-config-file\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.402018 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.401981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q6tr\" (UniqueName: \"kubernetes.io/projected/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-kube-api-access-8q6tr\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.402215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.402068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-config-file\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.402734 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.402715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-config-file\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.409984 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.409955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q6tr\" (UniqueName: \"kubernetes.io/projected/f69d056b-3577-46b9-a7e6-ccb78ff8aaa4-kube-api-access-8q6tr\") pod \"limitador-limitador-85d9db4d5d-s82s4\" (UID: \"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.496347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.496315    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:37.769552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.769528    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:16:37.771213 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:16:37.771165    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69d056b_3577_46b9_a7e6_ccb78ff8aaa4.slice/crio-d851a7db72ee5f23fbbbf8687b3160284a5553e99e4d63058e6556f824fc9bea WatchSource:0}: Error finding container d851a7db72ee5f23fbbbf8687b3160284a5553e99e4d63058e6556f824fc9bea: Status 404 returned error can't find the container with id d851a7db72ee5f23fbbbf8687b3160284a5553e99e4d63058e6556f824fc9bea
Sep 06 01:16:37.808951 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.808912    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:37.875136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:37.875114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:38.562609 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:38.562579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4" event={"ID":"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4","Type":"ContainerStarted","Data":"d851a7db72ee5f23fbbbf8687b3160284a5553e99e4d63058e6556f824fc9bea"}
Sep 06 01:16:39.568375 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:39.568340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4" event={"ID":"f69d056b-3577-46b9-a7e6-ccb78ff8aaa4","Type":"ContainerStarted","Data":"01eb3a8dc3221e018c27a46b7b9076a262653365c017e1af1ac622045d0d6615"}
Sep 06 01:16:39.568779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:39.568472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:39.586561 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:39.586510    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4" podStartSLOduration=1.313323849 podStartE2EDuration="2.586496048s" totalImagesPullingTime="1.273172199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:39.585744586 +0000 UTC m=+429.588226152" watchObservedRunningTime="2026-09-06 01:16:39.586496048 +0000 UTC m=+429.588977613"
Sep 06 01:16:50.573962 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:50.573933    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"
Sep 06 01:16:56.652533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:56.652426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:56.748117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:56.748088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:16:57.155878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:16:57.155850    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:08.936560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:08.936529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:09.046796 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:09.046731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:10.363224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:10.363130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:16.338533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:16.338501    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:16.409349 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:16.409319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:16.472571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:16.472539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:16.553139 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:16.553108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:16.618554 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:16.618477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:19.513774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:19.513741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:19.601896 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:19.601863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:30.809462 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:30.809422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:40.929771 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:40.929736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:40.987783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:40.987744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:51.134853 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:51.134817    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:51.234643 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:51.234607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:52.600218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:52.600169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:52.822053 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:52.822017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:53.093338 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:53.093309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:53.186100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:53.186071    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:17:53.287438 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:17:53.287397    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:18:02.794950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:02.794882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:02.897799 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:02.897764    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:14.063087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:14.063048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:14.863165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:14.863133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:15.214459 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:15.214426    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:18:23.238300 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.238172    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"]
Sep 06 01:18:23.240607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.240583    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.243030 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.243010    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2m2m5\""
Sep 06 01:18:23.243144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.243030    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 01:18:23.243144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.243107    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 01:18:23.244284 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.244268    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 06 01:18:23.251384 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.251361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"]
Sep 06 01:18:23.262849 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.262824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:23.400787 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.400946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q5xs\" (UniqueName: \"kubernetes.io/projected/57c8cec7-043d-4c4e-943f-ded09c74354a-kube-api-access-5q5xs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.400946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.400946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.400946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c8cec7-043d-4c4e-943f-ded09c74354a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.400946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.400894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q5xs\" (UniqueName: \"kubernetes.io/projected/57c8cec7-043d-4c4e-943f-ded09c74354a-kube-api-access-5q5xs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c8cec7-043d-4c4e-943f-ded09c74354a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502640    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.502908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.502689    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.504590 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.504568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c8cec7-043d-4c4e-943f-ded09c74354a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.504839 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.504819    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c8cec7-043d-4c4e-943f-ded09c74354a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.510747 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.510722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q5xs\" (UniqueName: \"kubernetes.io/projected/57c8cec7-043d-4c4e-943f-ded09c74354a-kube-api-access-5q5xs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-675h7\" (UID: \"57c8cec7-043d-4c4e-943f-ded09c74354a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.551318 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.551286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:23.825133 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.825077    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"]
Sep 06 01:18:23.827381 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:18:23.827355    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c8cec7_043d_4c4e_943f_ded09c74354a.slice/crio-9c16c3e862981094dbf10488eabef60b1cab902ce2d9d44171759ac8ae50d457 WatchSource:0}: Error finding container 9c16c3e862981094dbf10488eabef60b1cab902ce2d9d44171759ac8ae50d457: Status 404 returned error can't find the container with id 9c16c3e862981094dbf10488eabef60b1cab902ce2d9d44171759ac8ae50d457
Sep 06 01:18:23.893073 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:23.893043    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:18:24.037910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:24.037867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7" event={"ID":"57c8cec7-043d-4c4e-943f-ded09c74354a","Type":"ContainerStarted","Data":"9c16c3e862981094dbf10488eabef60b1cab902ce2d9d44171759ac8ae50d457"}
Sep 06 01:18:25.044369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:25.044337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7" event={"ID":"57c8cec7-043d-4c4e-943f-ded09c74354a","Type":"ContainerStarted","Data":"63a8412662dfc8ad6b041084997386e3f8d5564b5fb79aa4608a6daa1249e886"}
Sep 06 01:18:25.064375 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:25.064289    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7" podStartSLOduration=1.087861867 podStartE2EDuration="2.0642734s" totalImagesPullingTime="976.411533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:18:25.063256831 +0000 UTC m=+535.065738398" watchObservedRunningTime="2026-09-06 01:18:25.0642734 +0000 UTC m=+535.066754966"
Sep 06 01:18:29.532064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.532034    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"]
Sep 06 01:18:29.540200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.540161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.542629 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.542608    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 06 01:18:29.547845 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.547557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"]
Sep 06 01:18:29.591600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.591569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:29.653328 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.653463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bead89ee-317b-48d7-89fd-024989f01941-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.653463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5c7\" (UniqueName: \"kubernetes.io/projected/bead89ee-317b-48d7-89fd-024989f01941-kube-api-access-kb5c7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.653463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653413    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.653463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.653632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.653472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754342 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5c7\" (UniqueName: \"kubernetes.io/projected/bead89ee-317b-48d7-89fd-024989f01941-kube-api-access-kb5c7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754466    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bead89ee-317b-48d7-89fd-024989f01941-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754851 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.754887 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.754848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.756762 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.756740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bead89ee-317b-48d7-89fd-024989f01941-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.756907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.756891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bead89ee-317b-48d7-89fd-024989f01941-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.762332 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.762313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5c7\" (UniqueName: \"kubernetes.io/projected/bead89ee-317b-48d7-89fd-024989f01941-kube-api-access-kb5c7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qx787\" (UID: \"bead89ee-317b-48d7-89fd-024989f01941\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:29.851975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:29.851887    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:30.124545 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:30.124506    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"]
Sep 06 01:18:30.127448 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:18:30.127422    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbead89ee_317b_48d7_89fd_024989f01941.slice/crio-66bce269e2664bb8f7f30885d9bfadedee1675c4c9918c9e0efa7cb5c83ebfa8 WatchSource:0}: Error finding container 66bce269e2664bb8f7f30885d9bfadedee1675c4c9918c9e0efa7cb5c83ebfa8: Status 404 returned error can't find the container with id 66bce269e2664bb8f7f30885d9bfadedee1675c4c9918c9e0efa7cb5c83ebfa8
Sep 06 01:18:30.308040 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:30.308003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:18:31.074581 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:31.074547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787" event={"ID":"bead89ee-317b-48d7-89fd-024989f01941","Type":"ContainerStarted","Data":"44feaa74da1dfa3497bf3e72a01570a6d1fb306efc158e0b2eae2bdd308542d2"}
Sep 06 01:18:31.074961 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:31.074593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787" event={"ID":"bead89ee-317b-48d7-89fd-024989f01941","Type":"ContainerStarted","Data":"66bce269e2664bb8f7f30885d9bfadedee1675c4c9918c9e0efa7cb5c83ebfa8"}
Sep 06 01:18:31.095121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:31.095072    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787" podStartSLOduration=1.8974893750000001 podStartE2EDuration="2.095051687s" totalImagesPullingTime="197.562312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:18:31.094169038 +0000 UTC m=+541.096650605" watchObservedRunningTime="2026-09-06 01:18:31.095051687 +0000 UTC m=+541.097533255"
Sep 06 01:18:33.552339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:33.552304    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:33.552714 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:33.552398    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:33.564873 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:33.564853    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:34.099505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:34.099475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-675h7"
Sep 06 01:18:39.852880 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:39.852843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:39.853398 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:39.853202    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:39.865352 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:39.865327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:40.126818 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:40.126800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qx787"
Sep 06 01:18:46.066038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:46.065998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:47.151340 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:47.151304    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:18:53.238144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.238114    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"]
Sep 06 01:18:53.241005 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.240987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.243780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.243756    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 06 01:18:53.248612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.248575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"]
Sep 06 01:18:53.258956 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.258925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:18:53.365043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.365239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.365239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.365239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjgd\" (UniqueName: \"kubernetes.io/projected/bdc6a577-51f4-411b-ba5a-ed333ee82d13-kube-api-access-xjjgd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.365239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.365239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.365214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.465921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.465887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.465926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.465982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjgd\" (UniqueName: \"kubernetes.io/projected/bdc6a577-51f4-411b-ba5a-ed333ee82d13-kube-api-access-xjjgd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466373 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.466550 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.466522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.468243 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.468219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdc6a577-51f4-411b-ba5a-ed333ee82d13-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.468533 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.468516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdc6a577-51f4-411b-ba5a-ed333ee82d13-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.473461 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.473440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjgd\" (UniqueName: \"kubernetes.io/projected/bdc6a577-51f4-411b-ba5a-ed333ee82d13-kube-api-access-xjjgd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss\" (UID: \"bdc6a577-51f4-411b-ba5a-ed333ee82d13\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.552214 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.552123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:18:53.830291 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:53.830216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"]
Sep 06 01:18:53.835727 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:18:53.835702    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc6a577_51f4_411b_ba5a_ed333ee82d13.slice/crio-c8a158f5098978352b30a52645d39c456c683e1e8a784f93daa0036957a251b2 WatchSource:0}: Error finding container c8a158f5098978352b30a52645d39c456c683e1e8a784f93daa0036957a251b2: Status 404 returned error can't find the container with id c8a158f5098978352b30a52645d39c456c683e1e8a784f93daa0036957a251b2
Sep 06 01:18:54.179974 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:54.179943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss" event={"ID":"bdc6a577-51f4-411b-ba5a-ed333ee82d13","Type":"ContainerStarted","Data":"110e87fda0246fb22afd43583b990c51921aff31dc4e38b8657ddcae58d39b34"}
Sep 06 01:18:54.180172 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:54.180005    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss" event={"ID":"bdc6a577-51f4-411b-ba5a-ed333ee82d13","Type":"ContainerStarted","Data":"c8a158f5098978352b30a52645d39c456c683e1e8a784f93daa0036957a251b2"}
Sep 06 01:18:54.197915 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:54.197877    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss" podStartSLOduration=1.037349387 podStartE2EDuration="1.197860258s" totalImagesPullingTime="160.510871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:18:54.197036584 +0000 UTC m=+564.199518178" watchObservedRunningTime="2026-09-06 01:18:54.197860258 +0000 UTC m=+564.200341824"
Sep 06 01:18:54.700017 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:18:54.699991    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:19:00.536237 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:00.536168    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:19:02.205014 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:02.204979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:19:03.552359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:03.552324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:19:03.552790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:03.552381    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:19:03.564770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:03.564748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:19:04.234005 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:04.233980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss"
Sep 06 01:19:07.642432 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.642397    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"]
Sep 06 01:19:07.646355 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.646333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.648791 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.648767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 06 01:19:07.657037 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.657016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"]
Sep 06 01:19:07.668126 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.668091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:19:07.790706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7403f46e-0dfd-447f-9668-caa777fa4bc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.790862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.790862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slflv\" (UniqueName: \"kubernetes.io/projected/7403f46e-0dfd-447f-9668-caa777fa4bc9-kube-api-access-slflv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.790862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.790862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.790862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.790846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7403f46e-0dfd-447f-9668-caa777fa4bc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slflv\" (UniqueName: \"kubernetes.io/projected/7403f46e-0dfd-447f-9668-caa777fa4bc9-kube-api-access-slflv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.891960 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.891934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.893938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.893886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7403f46e-0dfd-447f-9668-caa777fa4bc9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.894389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.894371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7403f46e-0dfd-447f-9668-caa777fa4bc9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.899929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.899907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slflv\" (UniqueName: \"kubernetes.io/projected/7403f46e-0dfd-447f-9668-caa777fa4bc9-kube-api-access-slflv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7sp56\" (UID: \"7403f46e-0dfd-447f-9668-caa777fa4bc9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:07.956317 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:07.956296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:08.230008 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:08.229977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"]
Sep 06 01:19:08.232191 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:19:08.232150    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7403f46e_0dfd_447f_9668_caa777fa4bc9.slice/crio-a552491b28298332368d25dcfcd5e9db08ded6495460ed0ab9fe8633cac6e020 WatchSource:0}: Error finding container a552491b28298332368d25dcfcd5e9db08ded6495460ed0ab9fe8633cac6e020: Status 404 returned error can't find the container with id a552491b28298332368d25dcfcd5e9db08ded6495460ed0ab9fe8633cac6e020
Sep 06 01:19:08.242568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:08.242543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56" event={"ID":"7403f46e-0dfd-447f-9668-caa777fa4bc9","Type":"ContainerStarted","Data":"a552491b28298332368d25dcfcd5e9db08ded6495460ed0ab9fe8633cac6e020"}
Sep 06 01:19:09.248255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:09.248224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56" event={"ID":"7403f46e-0dfd-447f-9668-caa777fa4bc9","Type":"ContainerStarted","Data":"2240d1c166d75edf0eb6ffeb86314746078c7a717cfb2b9ea66685698db138d9"}
Sep 06 01:19:09.265103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:09.265053    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56" podStartSLOduration=2.099972539 podStartE2EDuration="2.265035245s" totalImagesPullingTime="165.062706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:19:09.264624535 +0000 UTC m=+579.267106105" watchObservedRunningTime="2026-09-06 01:19:09.265035245 +0000 UTC m=+579.267516814"
Sep 06 01:19:09.700137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:09.700106    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:19:17.957239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:17.957171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:17.957636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:17.957263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:17.969663 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:17.969638    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:18.301793 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:18.301718    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7sp56"
Sep 06 01:19:30.436478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:30.436447    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:19:30.437483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:19:30.437464    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:20:13.060802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:13.060697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:14.288834 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:14.288780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:29.654101 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:29.654070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:29.794707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:29.794677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:29.975100 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:29.975015    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:30.081600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:30.081570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:31.019414 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:31.019378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:31.159523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:31.159496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:31.477757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:31.477729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:33.605719 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:33.605684    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:20:35.505057 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:35.505026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:35.596766 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:35.596730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:36.663795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:36.663761    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:36.797568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:36.797535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:37.194973 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:37.194941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:37.293701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:37.293669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:38.120119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:38.120078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:38.180796 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:38.180756    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:38.335538 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:38.335510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:38.686097 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:38.686065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:38.971361 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:38.971269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:41.045202 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:41.045142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:41.137086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:41.137042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:41.386327 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:41.386299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:41.693212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:41.693105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:41.938040 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:41.938006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:42.248732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:42.248704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:42.400895 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:42.400862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:42.846498 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:42.846463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:42.939188 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:42.939159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:44.905034 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:44.905004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:45.000024 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:44.999996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:45.632348 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.632311    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:20:45.635613 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.635596    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.638043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.638021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-87f1b0e6-kserve-self-signed-certs\""
Sep 06 01:20:45.645068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.645040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:20:45.745840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.745809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.746038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.745843    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.746038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.745871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.746038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.745907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mqv\" (UniqueName: \"kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.746038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.745952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.746038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.746020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847156 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847156 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mqv\" (UniqueName: \"kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847333    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847647 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847647 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.847748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.847686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.849618 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.849597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.849855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.849837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.854875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.854850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mqv\" (UniqueName: \"kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv\") pod \"e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") " pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:45.932835 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.932763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:45.945056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:45.945029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:46.216897 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.216873    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:20:46.219342 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:20:46.219307    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda12af142_a866_408e_b986_96f172e04476.slice/crio-d5decf3fd1530c932d1b2dbd69d690888640eb00a3bc49302d869677a7bfaad0 WatchSource:0}: Error finding container d5decf3fd1530c932d1b2dbd69d690888640eb00a3bc49302d869677a7bfaad0: Status 404 returned error can't find the container with id d5decf3fd1530c932d1b2dbd69d690888640eb00a3bc49302d869677a7bfaad0
Sep 06 01:20:46.332783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.332752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:46.699388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.699353    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:46.704469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.704442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" event={"ID":"a12af142-a866-408e-b986-96f172e04476","Type":"ContainerStarted","Data":"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"}
Sep 06 01:20:46.704608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.704482    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" event={"ID":"a12af142-a866-408e-b986-96f172e04476","Type":"ContainerStarted","Data":"d5decf3fd1530c932d1b2dbd69d690888640eb00a3bc49302d869677a7bfaad0"}
Sep 06 01:20:46.721240 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.721173    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" podStartSLOduration=1.7211575350000001 podStartE2EDuration="1.721157535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:46.720235155 +0000 UTC m=+676.722716721" watchObservedRunningTime="2026-09-06 01:20:46.721157535 +0000 UTC m=+676.723639100"
Sep 06 01:20:46.823970 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.823938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:46.930309 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:46.930277    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:47.220839 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:47.220800    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:20:48.255931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:48.255904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:48.415548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:48.415522    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:48.512579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:48.512498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:54.636313 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:54.636282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:54.728774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:54.728743    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:54.832706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:54.832675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:20:55.945446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:55.945414    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:55.945813 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:55.945476    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:55.957672 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:55.957649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:20:56.761081 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:20:56.761051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:21:00.427008 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.426977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:00.553251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.553226    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:00.662198 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.662146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:00.756164 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.756094    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:00.857140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.857111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:00.955221 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:00.955193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:01.028955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:01.028869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:01.125502 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:01.125471    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:03.755563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:03.755531    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:03.847221 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:03.847165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:05.101150 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.101123    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:05.465674 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.465642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:05.569203 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.569150    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:05.652686 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.652656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:05.656690 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.656663    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:21:05.660091 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.660069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.662676 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.662659    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-4b217a\""
Sep 06 01:21:05.662903 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.662888    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-4b217a-dockercfg-pkbxj\""
Sep 06 01:21:05.671440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.671420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:21:05.828306 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.828227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.828306 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.828284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvdxz\" (UniqueName: \"kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.929829 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.929800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.929983 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.929850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvdxz\" (UniqueName: \"kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.930494 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.930468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.940027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.939996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvdxz\" (UniqueName: \"kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz\") pod \"payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:05.971383 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:05.971362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:06.245488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.245469    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:21:06.247557 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:21:06.247532    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7ab164_3425_48aa_87f5_475fc6c4a5b1.slice/crio-28e7e7469710fb5e17916cb5aff80587d71eb9474f45ff43e213df583b4d4c47 WatchSource:0}: Error finding container 28e7e7469710fb5e17916cb5aff80587d71eb9474f45ff43e213df583b4d4c47: Status 404 returned error can't find the container with id 28e7e7469710fb5e17916cb5aff80587d71eb9474f45ff43e213df583b4d4c47
Sep 06 01:21:06.249521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.249505    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:21:06.469780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.469746    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"]
Sep 06 01:21:06.474418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.474382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:06.476785 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.476760    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:21:06.476880 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.476835    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:21:06.481732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.481704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"]
Sep 06 01:21:06.635741 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.635701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-267e7071-72lxs\" (UID: \"c6eef044-4ac8-4ffa-9d36-40a3991e7994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:06.736639 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.736607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-267e7071-72lxs\" (UID: \"c6eef044-4ac8-4ffa-9d36-40a3991e7994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:06.737304 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.737285    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-267e7071-72lxs\" (UID: \"c6eef044-4ac8-4ffa-9d36-40a3991e7994\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:06.787829 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.787801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:06.799253 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.799222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" event={"ID":"ae7ab164-3425-48aa-87f5-475fc6c4a5b1","Type":"ContainerStarted","Data":"28e7e7469710fb5e17916cb5aff80587d71eb9474f45ff43e213df583b4d4c47"}
Sep 06 01:21:06.907075 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:06.906994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:21:07.057765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:07.057743    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"]
Sep 06 01:21:07.059645 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:21:07.059621    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eef044_4ac8_4ffa_9d36_40a3991e7994.slice/crio-c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f WatchSource:0}: Error finding container c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f: Status 404 returned error can't find the container with id c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f
Sep 06 01:21:07.629325 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:07.629276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:07.729366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:07.729334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:07.806196 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:07.806150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs" event={"ID":"c6eef044-4ac8-4ffa-9d36-40a3991e7994","Type":"ContainerStarted","Data":"c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f"}
Sep 06 01:21:08.816147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:08.816111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" event={"ID":"ae7ab164-3425-48aa-87f5-475fc6c4a5b1","Type":"ContainerStarted","Data":"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"}
Sep 06 01:21:08.816667 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:08.816203    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:08.833824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:08.833762    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" podStartSLOduration=1.821496884 podStartE2EDuration="3.833745674s" totalImagesPullingTime="2.01224879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:08.831941826 +0000 UTC m=+698.834423399" watchObservedRunningTime="2026-09-06 01:21:08.833745674 +0000 UTC m=+698.836227239"
Sep 06 01:21:09.726802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:09.726773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:10.827275 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:10.827193    2582 generic.go:356] "Generic (PLEG): container finished" podID="c6eef044-4ac8-4ffa-9d36-40a3991e7994" containerID="ce4d1d5238709da9e142d422c2d632bf474a38fd5c648e46616b9e67f049f02b" exitCode=0
Sep 06 01:21:10.827275 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:10.827209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs" event={"ID":"c6eef044-4ac8-4ffa-9d36-40a3991e7994","Type":"ContainerDied","Data":"ce4d1d5238709da9e142d422c2d632bf474a38fd5c648e46616b9e67f049f02b"}
Sep 06 01:21:11.963830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:11.963805    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:11.987389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:11.987362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca\") pod \"c6eef044-4ac8-4ffa-9d36-40a3991e7994\" (UID: \"c6eef044-4ac8-4ffa-9d36-40a3991e7994\") "
Sep 06 01:21:11.987753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:11.987728    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6eef044-4ac8-4ffa-9d36-40a3991e7994" (UID: "c6eef044-4ac8-4ffa-9d36-40a3991e7994"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:12.088247 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:12.088155    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6eef044-4ac8-4ffa-9d36-40a3991e7994-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:21:12.515782 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:21:12.515750    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6eef044_4ac8_4ffa_9d36_40a3991e7994.slice\": RecentStats: unable to find data in memory cache]"
Sep 06 01:21:12.837576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:12.837485    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs" event={"ID":"c6eef044-4ac8-4ffa-9d36-40a3991e7994","Type":"ContainerDied","Data":"c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f"}
Sep 06 01:21:12.837576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:12.837511    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"
Sep 06 01:21:12.837576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:12.837531    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c58e9e0af1020e561d44ad10a68771206e2dade25218a8c24d5f2f34d4be763f"
Sep 06 01:21:19.822530 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:19.822498    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:21:23.411164 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.411090    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:23.511979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.511950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:23.604085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.604052    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"]
Sep 06 01:21:23.606352 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.606319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:23.608256 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.608236    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-267e7071-72lxs"]
Sep 06 01:21:23.663293 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.663237    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:23.746252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:23.746222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:24.161041 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:24.161013    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:24.260556 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:24.260530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:24.365433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:24.365405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:24.476990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:24.476913    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6eef044-4ac8-4ffa-9d36-40a3991e7994" path="/var/lib/kubelet/pods/c6eef044-4ac8-4ffa-9d36-40a3991e7994/volumes"
Sep 06 01:21:24.687317 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:24.687288    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:25.147840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:25.147811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:26.591504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:26.591464    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:26.696506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:26.696480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:27.461277 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:27.461252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:27.559826 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:27.559794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:27.660620 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:27.660576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:27.997015 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:27.996985    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:28.208470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.208437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:28.226940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.226907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:21:28.303250 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.303132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:28.329685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.329653    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:21:28.330061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.330048    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6eef044-4ac8-4ffa-9d36-40a3991e7994" containerName="revoke-keys"
Sep 06 01:21:28.330118 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.330073    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6eef044-4ac8-4ffa-9d36-40a3991e7994" containerName="revoke-keys"
Sep 06 01:21:28.330210 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.330170    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6eef044-4ac8-4ffa-9d36-40a3991e7994" containerName="revoke-keys"
Sep 06 01:21:28.333222 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.333207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.335707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.335685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-52c53f94\""
Sep 06 01:21:28.335707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.335699    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-52c53f94-dockercfg-wwgd5\""
Sep 06 01:21:28.343948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.343927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:21:28.436759 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.436728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fvbl\" (UniqueName: \"kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.436937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.436865    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.537448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.537413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.537615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.537456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fvbl\" (UniqueName: \"kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.538064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.538044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.548279 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.548247    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fvbl\" (UniqueName: \"kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl\") pod \"payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") " pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.643727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.643706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:28.692917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.692871    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:28.916023 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:28.915825    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:21:28.918406 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:21:28.918380    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81fca88_c628_482d_86aa_bb94f539cbe5.slice/crio-5b47e5690ed73c08ecc3d8e0efe2c4d24b0893cb3549c555f570d735aa90f22a WatchSource:0}: Error finding container 5b47e5690ed73c08ecc3d8e0efe2c4d24b0893cb3549c555f570d735aa90f22a: Status 404 returned error can't find the container with id 5b47e5690ed73c08ecc3d8e0efe2c4d24b0893cb3549c555f570d735aa90f22a
Sep 06 01:21:29.924953 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:29.924918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" event={"ID":"a81fca88-c628-482d-86aa-bb94f539cbe5","Type":"ContainerStarted","Data":"8c52e55a5de79408c0c997fbd37c2c25003243d07385f089170446c9cd40ec08"}
Sep 06 01:21:29.925336 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:29.924978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" event={"ID":"a81fca88-c628-482d-86aa-bb94f539cbe5","Type":"ContainerStarted","Data":"5b47e5690ed73c08ecc3d8e0efe2c4d24b0893cb3549c555f570d735aa90f22a"}
Sep 06 01:21:29.925336 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:29.925061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:29.943158 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:29.943116    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" podStartSLOduration=1.9431027360000002 podStartE2EDuration="1.943102736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:29.941082869 +0000 UTC m=+719.943564445" watchObservedRunningTime="2026-09-06 01:21:29.943102736 +0000 UTC m=+719.945584293"
Sep 06 01:21:40.932349 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:40.932313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:21:45.231408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.231374    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:21:45.236579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.236560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.238889 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.238868    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-87f1b0e6-kserve-self-signed-certs\""
Sep 06 01:21:45.245057 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.245035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:21:45.346761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.346727    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:45.393521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.393681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwnv\" (UniqueName: \"kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.393681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.393681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393641    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.393786 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.393786 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.393715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495240 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495274    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwnv\" (UniqueName: \"kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495597 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495578    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.495756 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.495709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.497713 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.497691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.497882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.497865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.518405 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.518381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwnv\" (UniqueName: \"kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv\") pod \"e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") " pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.546223 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.546197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:45.821928 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:45.820483    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:21:46.004891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:46.004855    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" event={"ID":"db5c4e1a-b51b-4d21-9c55-1e74df330e04","Type":"ContainerStarted","Data":"489a8cd2838397e8505b3906d0ade30ff16c012fa0c63014b6183a3d6e99e0c2"}
Sep 06 01:21:46.004891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:46.004900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" event={"ID":"db5c4e1a-b51b-4d21-9c55-1e74df330e04","Type":"ContainerStarted","Data":"e8c623abca9036c8b9667f40e7e326015e986cddb45f185142d87ab2cfa9dd2f"}
Sep 06 01:21:46.023028 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:46.022976    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" podStartSLOduration=1.022961266 podStartE2EDuration="1.022961266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:46.021861566 +0000 UTC m=+736.024343133" watchObservedRunningTime="2026-09-06 01:21:46.022961266 +0000 UTC m=+736.025442832"
Sep 06 01:21:48.487863 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:48.487831    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:48.590341 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:48.590311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:21:50.005843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:50.005804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:21:55.547261 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:55.547226    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:55.547713 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:55.547283    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:55.559534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:55.559510    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:21:56.066142 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:21:56.066106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:22:06.536021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.535981    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:22:06.542259 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.540765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.545246 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.545224    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-20c535\"/\"openshift-service-ca.crt\""
Sep 06 01:22:06.545483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.545223    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-20c535\"/\"autores-model-20c535-kserve-self-signed-certs\""
Sep 06 01:22:06.545615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.545270    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-20c535\"/\"default-dockercfg-kwvp6\""
Sep 06 01:22:06.545615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.545274    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-20c535\"/\"kube-root-ca.crt\""
Sep 06 01:22:06.549078 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.549056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:22:06.594607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.594722 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.594722 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.594828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.594828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594770    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.594828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.594789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdvc7\" (UniqueName: \"kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.651745 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.651710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:06.696077 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdvc7\" (UniqueName: \"kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696694 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.696735 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.696718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.698610 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.698589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.698783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.698763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.705806 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.705786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdvc7\" (UniqueName: \"kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7\") pod \"autores-model-20c535-kserve-8596689879-j8vmw\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") " pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:06.853332 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:06.853249    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:07.125704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:07.125682    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:22:07.127637 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:22:07.127612    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb55ace7c_afe1_471e_8527_e99bbc9500a6.slice/crio-6ded08a717aae3772b3737d84eab82a4e64eecd838b5bcb6c05964b186341739 WatchSource:0}: Error finding container 6ded08a717aae3772b3737d84eab82a4e64eecd838b5bcb6c05964b186341739: Status 404 returned error can't find the container with id 6ded08a717aae3772b3737d84eab82a4e64eecd838b5bcb6c05964b186341739
Sep 06 01:22:08.116490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:08.116453    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" event={"ID":"b55ace7c-afe1-471e-8527-e99bbc9500a6","Type":"ContainerStarted","Data":"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"}
Sep 06 01:22:08.116863 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:08.116498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" event={"ID":"b55ace7c-afe1-471e-8527-e99bbc9500a6","Type":"ContainerStarted","Data":"6ded08a717aae3772b3737d84eab82a4e64eecd838b5bcb6c05964b186341739"}
Sep 06 01:22:08.133358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:08.133301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" podStartSLOduration=2.13328432 podStartE2EDuration="2.13328432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:08.132032756 +0000 UTC m=+758.134514533" watchObservedRunningTime="2026-09-06 01:22:08.13328432 +0000 UTC m=+758.135765885"
Sep 06 01:22:08.977024 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:08.976979    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.006237 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.006210    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:22:09.006435 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.006412    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" podUID="a81fca88-c628-482d-86aa-bb94f539cbe5" containerName="payload-processing" containerID="cri-o://8c52e55a5de79408c0c997fbd37c2c25003243d07385f089170446c9cd40ec08" gracePeriod=30
Sep 06 01:22:09.080362 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.080335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.123715 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.123680    2582 generic.go:356] "Generic (PLEG): container finished" podID="a81fca88-c628-482d-86aa-bb94f539cbe5" containerID="8c52e55a5de79408c0c997fbd37c2c25003243d07385f089170446c9cd40ec08" exitCode=0
Sep 06 01:22:09.124076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.123746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" event={"ID":"a81fca88-c628-482d-86aa-bb94f539cbe5","Type":"ContainerDied","Data":"8c52e55a5de79408c0c997fbd37c2c25003243d07385f089170446c9cd40ec08"}
Sep 06 01:22:09.160554 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.160528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.218408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.218375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.265289 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.265265    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:22:09.314595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.314561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.320733 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.320707    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume\") pod \"a81fca88-c628-482d-86aa-bb94f539cbe5\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") "
Sep 06 01:22:09.320852 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.320739    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fvbl\" (UniqueName: \"kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl\") pod \"a81fca88-c628-482d-86aa-bb94f539cbe5\" (UID: \"a81fca88-c628-482d-86aa-bb94f539cbe5\") "
Sep 06 01:22:09.321055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.321035    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a81fca88-c628-482d-86aa-bb94f539cbe5" (UID: "a81fca88-c628-482d-86aa-bb94f539cbe5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:09.323023 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.322999    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl" (OuterVolumeSpecName: "kube-api-access-6fvbl") pod "a81fca88-c628-482d-86aa-bb94f539cbe5" (UID: "a81fca88-c628-482d-86aa-bb94f539cbe5"). InnerVolumeSpecName "kube-api-access-6fvbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:09.421979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.421952    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81fca88-c628-482d-86aa-bb94f539cbe5-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.421979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.421975    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fvbl\" (UniqueName: \"kubernetes.io/projected/a81fca88-c628-482d-86aa-bb94f539cbe5-kube-api-access-6fvbl\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.701918 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.701889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:09.998288 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:09.998210    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:10.094738 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.094708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:10.130292 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.130264    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"
Sep 06 01:22:10.130727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.130309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr" event={"ID":"a81fca88-c628-482d-86aa-bb94f539cbe5","Type":"ContainerDied","Data":"5b47e5690ed73c08ecc3d8e0efe2c4d24b0893cb3549c555f570d735aa90f22a"}
Sep 06 01:22:10.130727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.130375    2582 scope.go:117] "RemoveContainer" containerID="8c52e55a5de79408c0c997fbd37c2c25003243d07385f089170446c9cd40ec08"
Sep 06 01:22:10.154643 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.154617    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:22:10.156362 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.156342    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-52c53f94-55f8cffc4b-7xxhr"]
Sep 06 01:22:10.477913 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:10.477882    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81fca88-c628-482d-86aa-bb94f539cbe5" path="/var/lib/kubelet/pods/a81fca88-c628-482d-86aa-bb94f539cbe5/volumes"
Sep 06 01:22:12.668452 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:12.668417    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:12.765006 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:12.764975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:13.868379 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:13.868350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:14.200764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.200725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:14.341332 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.341305    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:14.437917 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.437884    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:14.450602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.450572    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:14.451011 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.450971    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81fca88-c628-482d-86aa-bb94f539cbe5" containerName="payload-processing"
Sep 06 01:22:14.451011 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.450985    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81fca88-c628-482d-86aa-bb94f539cbe5" containerName="payload-processing"
Sep 06 01:22:14.451105 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.451053    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81fca88-c628-482d-86aa-bb94f539cbe5" containerName="payload-processing"
Sep 06 01:22:14.455689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.455674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.458867 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.458848    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-62f64172-dockercfg-j5z8m\""
Sep 06 01:22:14.459017 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.459002    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-62f64172\""
Sep 06 01:22:14.479037 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.479014    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:14.545858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.545831    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:22:14.567616 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.567592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmqx\" (UniqueName: \"kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.567723 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.567653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.668635 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.668605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.668816 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.668716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmqx\" (UniqueName: \"kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.669433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.669411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.676894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.676871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmqx\" (UniqueName: \"kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx\") pod \"payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:14.765630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:14.765552    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:15.038058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:15.038035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:15.158636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:15.158610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" event={"ID":"4acc0af3-3825-41d6-b4c2-0439b8b40c8b","Type":"ContainerStarted","Data":"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"}
Sep 06 01:22:15.158800 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:15.158655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" event={"ID":"4acc0af3-3825-41d6-b4c2-0439b8b40c8b","Type":"ContainerStarted","Data":"c1975e5844bf874ad8db9defbe02fdf634242ee20b68ee16849505fbab7a8e9a"}
Sep 06 01:22:15.158800 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:15.158723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:15.176140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:15.176091    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" podStartSLOduration=1.176079122 podStartE2EDuration="1.176079122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:15.174381877 +0000 UTC m=+765.176863444" watchObservedRunningTime="2026-09-06 01:22:15.176079122 +0000 UTC m=+765.178560685"
Sep 06 01:22:16.853612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:16.853580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:16.854069 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:16.853823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:16.866162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:16.866136    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:17.181821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:17.181796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:22:26.166698 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:26.166669    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:30.025055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.025017    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:22:30.028737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.028716    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.032458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.032408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b63fa0\"/\"test-model-b63fa0-kserve-self-signed-certs\""
Sep 06 01:22:30.032458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.032427    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b63fa0\"/\"openshift-service-ca.crt\""
Sep 06 01:22:30.032665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.032427    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b63fa0\"/\"default-dockercfg-xk6qj\""
Sep 06 01:22:30.032665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.032411    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b63fa0\"/\"kube-root-ca.crt\""
Sep 06 01:22:30.038596 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.038577    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:22:30.051315 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.051293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:30.115608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.115767 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.115767 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.115891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115814    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.115891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrwqg\" (UniqueName: \"kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.115891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.115883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216678 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216678 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216916 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrwqg\" (UniqueName: \"kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216916 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216916 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.216916 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.216790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.217128 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.217096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.217217 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.217142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.217266 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.217239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.219188 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.219157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.219578 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.219557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.246193 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.246149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrwqg\" (UniqueName: \"kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg\") pod \"test-model-b63fa0-kserve-585d7fbf65-zgcjz\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") " pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.338573 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.338500    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:30.614395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:30.614368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:22:30.616085 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:22:30.616043    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod787387e8_e8ed_4309_ba69_9fe3dee5b6f3.slice/crio-857bf99e0ae4d5cae1f86f97b4731ca631cd9dd1fc5cb2dab3007a55c980ef07 WatchSource:0}: Error finding container 857bf99e0ae4d5cae1f86f97b4731ca631cd9dd1fc5cb2dab3007a55c980ef07: Status 404 returned error can't find the container with id 857bf99e0ae4d5cae1f86f97b4731ca631cd9dd1fc5cb2dab3007a55c980ef07
Sep 06 01:22:31.242244 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:31.242211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" event={"ID":"787387e8-e8ed-4309-ba69-9fe3dee5b6f3","Type":"ContainerStarted","Data":"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"}
Sep 06 01:22:31.242601 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:31.242261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" event={"ID":"787387e8-e8ed-4309-ba69-9fe3dee5b6f3","Type":"ContainerStarted","Data":"857bf99e0ae4d5cae1f86f97b4731ca631cd9dd1fc5cb2dab3007a55c980ef07"}
Sep 06 01:22:31.258096 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:31.258053    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" podStartSLOduration=1.258038978 podStartE2EDuration="1.258038978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:31.256785923 +0000 UTC m=+781.259267489" watchObservedRunningTime="2026-09-06 01:22:31.258038978 +0000 UTC m=+781.260520543"
Sep 06 01:22:32.036964 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:32.036924    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:22:32.050465 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:32.050411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:33.126236 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:33.126206    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:22:33.145704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:33.145677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:36.214769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:36.214731    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:22:40.339164 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:40.339132    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:40.339548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:40.339193    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:40.351869 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:40.351845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:41.304262 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:41.304232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:22:44.264415 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.264384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:44.291651 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.291617    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:44.291889 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.291861    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" podUID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" containerName="payload-pre-processing" containerID="cri-o://cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff" gracePeriod=30
Sep 06 01:22:44.365378 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.365347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:44.432933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.432904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:44.505582 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.505555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:44.542447 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.542422    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:44.645076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.645036    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfmqx\" (UniqueName: \"kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx\") pod \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") "
Sep 06 01:22:44.645317 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.645114    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume\") pod \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\" (UID: \"4acc0af3-3825-41d6-b4c2-0439b8b40c8b\") "
Sep 06 01:22:44.645482 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.645460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4acc0af3-3825-41d6-b4c2-0439b8b40c8b" (UID: "4acc0af3-3825-41d6-b4c2-0439b8b40c8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:44.647295 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.647279    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx" (OuterVolumeSpecName: "kube-api-access-xfmqx") pod "4acc0af3-3825-41d6-b4c2-0439b8b40c8b" (UID: "4acc0af3-3825-41d6-b4c2-0439b8b40c8b"). InnerVolumeSpecName "kube-api-access-xfmqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:44.746219 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.746161    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfmqx\" (UniqueName: \"kubernetes.io/projected/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-kube-api-access-xfmqx\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:44.746219 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:44.746211    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4acc0af3-3825-41d6-b4c2-0439b8b40c8b-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:45.316467 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.316435    2582 generic.go:356] "Generic (PLEG): container finished" podID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" containerID="cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff" exitCode=0
Sep 06 01:22:45.316907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.316485    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"
Sep 06 01:22:45.316907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.316518    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" event={"ID":"4acc0af3-3825-41d6-b4c2-0439b8b40c8b","Type":"ContainerDied","Data":"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"}
Sep 06 01:22:45.316907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.316575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4" event={"ID":"4acc0af3-3825-41d6-b4c2-0439b8b40c8b","Type":"ContainerDied","Data":"c1975e5844bf874ad8db9defbe02fdf634242ee20b68ee16849505fbab7a8e9a"}
Sep 06 01:22:45.316907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.316612    2582 scope.go:117] "RemoveContainer" containerID="cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"
Sep 06 01:22:45.325853 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.325836    2582 scope.go:117] "RemoveContainer" containerID="cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"
Sep 06 01:22:45.326117 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:22:45.326099    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff\": container with ID starting with cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff not found: ID does not exist" containerID="cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"
Sep 06 01:22:45.326156 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.326127    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff"} err="failed to get container status \"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff\": rpc error: code = NotFound desc = could not find container \"cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff\": container with ID starting with cf00dffadcd8aa103a576d74ddb6674b0e89e2eb7081c969fc9f157167bc36ff not found: ID does not exist"
Sep 06 01:22:45.338896 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.338875    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:45.343229 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.343210    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-62f64172-6dd89d8866-rk5l4"]
Sep 06 01:22:45.494580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.494550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:45.909162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:45.909136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:46.203121 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:46.203042    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:46.371402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:46.371374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:46.478477 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:46.478387    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" path="/var/lib/kubelet/pods/4acc0af3-3825-41d6-b4c2-0439b8b40c8b/volumes"
Sep 06 01:22:47.057649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.057611    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" podUID="a12af142-a866-408e-b986-96f172e04476" containerName="main" containerID="cri-o://45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925" gracePeriod=45
Sep 06 01:22:47.317850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.317793    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:22:47.329869 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.329835    2582 generic.go:356] "Generic (PLEG): container finished" podID="a12af142-a866-408e-b986-96f172e04476" containerID="45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925" exitCode=0
Sep 06 01:22:47.329994 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.329888    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"
Sep 06 01:22:47.329994 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.329878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" event={"ID":"a12af142-a866-408e-b986-96f172e04476","Type":"ContainerDied","Data":"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"}
Sep 06 01:22:47.330102 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.330034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq" event={"ID":"a12af142-a866-408e-b986-96f172e04476","Type":"ContainerDied","Data":"d5decf3fd1530c932d1b2dbd69d690888640eb00a3bc49302d869677a7bfaad0"}
Sep 06 01:22:47.330102 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.330054    2582 scope.go:117] "RemoveContainer" containerID="45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"
Sep 06 01:22:47.339677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.339656    2582 scope.go:117] "RemoveContainer" containerID="45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"
Sep 06 01:22:47.340013 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:22:47.339990    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925\": container with ID starting with 45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925 not found: ID does not exist" containerID="45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"
Sep 06 01:22:47.340098 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.340020    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925"} err="failed to get container status \"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925\": rpc error: code = NotFound desc = could not find container \"45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925\": container with ID starting with 45a1009bf45f885b2872ddb3e2a8ffd699d2c1e9695c683811a30ed7b0b7e925 not found: ID does not exist"
Sep 06 01:22:47.374256 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374229    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374289    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374384    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374427    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8mqv\" (UniqueName: \"kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir\") pod \"a12af142-a866-408e-b986-96f172e04476\" (UID: \"a12af142-a866-408e-b986-96f172e04476\") "
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374481    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home" (OuterVolumeSpecName: "home") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:47.374705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374598    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache" (OuterVolumeSpecName: "model-cache") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:47.375137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374725    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.375137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374742    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.375137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.374777    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:47.376809 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.376780    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:22:47.376809 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.376795    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv" (OuterVolumeSpecName: "kube-api-access-w8mqv") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "kube-api-access-w8mqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:47.376941 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.376837    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm" (OuterVolumeSpecName: "dshm") pod "a12af142-a866-408e-b986-96f172e04476" (UID: "a12af142-a866-408e-b986-96f172e04476"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:47.475552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.475521    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.475552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.475551    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a12af142-a866-408e-b986-96f172e04476-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.475748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.475567    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8mqv\" (UniqueName: \"kubernetes.io/projected/a12af142-a866-408e-b986-96f172e04476-kube-api-access-w8mqv\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.475748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.475579    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a12af142-a866-408e-b986-96f172e04476-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:47.651332 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.651302    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:22:47.655583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:47.655561    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-87f1b0e6-kserve-74d5b9989d-7qnbq"]
Sep 06 01:22:48.147315 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.147263    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" podUID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" containerName="main" containerID="cri-o://489a8cd2838397e8505b3906d0ade30ff16c012fa0c63014b6183a3d6e99e0c2" gracePeriod=45
Sep 06 01:22:48.338721 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.338675    2582 generic.go:356] "Generic (PLEG): container finished" podID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" containerID="489a8cd2838397e8505b3906d0ade30ff16c012fa0c63014b6183a3d6e99e0c2" exitCode=0
Sep 06 01:22:48.338882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.338748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" event={"ID":"db5c4e1a-b51b-4d21-9c55-1e74df330e04","Type":"ContainerDied","Data":"489a8cd2838397e8505b3906d0ade30ff16c012fa0c63014b6183a3d6e99e0c2"}
Sep 06 01:22:48.399908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.399853    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:22:48.477460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.477426    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a12af142-a866-408e-b986-96f172e04476" path="/var/lib/kubelet/pods/a12af142-a866-408e-b986-96f172e04476/volumes"
Sep 06 01:22:48.484370 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484345    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.484537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484376    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqwnv\" (UniqueName: \"kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.484537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.484537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484446    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.484537 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484501    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.484757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:48.484817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484756    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache" (OuterVolumeSpecName: "model-cache") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:48.484901 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.484881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home\") pod \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\" (UID: \"db5c4e1a-b51b-4d21-9c55-1e74df330e04\") "
Sep 06 01:22:48.485110 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.485088    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home" (OuterVolumeSpecName: "home") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:48.485266 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.485237    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.485266 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.485269    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.485384 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.485280    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.487200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.487156    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm" (OuterVolumeSpecName: "dshm") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:48.487311 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.487290    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv" (OuterVolumeSpecName: "kube-api-access-pqwnv") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "kube-api-access-pqwnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:48.487369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.487305    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db5c4e1a-b51b-4d21-9c55-1e74df330e04" (UID: "db5c4e1a-b51b-4d21-9c55-1e74df330e04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:22:48.586677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.586647    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db5c4e1a-b51b-4d21-9c55-1e74df330e04-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.586677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.586677    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqwnv\" (UniqueName: \"kubernetes.io/projected/db5c4e1a-b51b-4d21-9c55-1e74df330e04-kube-api-access-pqwnv\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.586912 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.586688    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db5c4e1a-b51b-4d21-9c55-1e74df330e04-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:22:48.907595 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:48.907546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:49.000979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.000953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:49.346539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.346463    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"
Sep 06 01:22:49.346539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.346507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh" event={"ID":"db5c4e1a-b51b-4d21-9c55-1e74df330e04","Type":"ContainerDied","Data":"e8c623abca9036c8b9667f40e7e326015e986cddb45f185142d87ab2cfa9dd2f"}
Sep 06 01:22:49.346711 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.346560    2582 scope.go:117] "RemoveContainer" containerID="489a8cd2838397e8505b3906d0ade30ff16c012fa0c63014b6183a3d6e99e0c2"
Sep 06 01:22:49.368763 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.368740    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:22:49.371988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:49.371964    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-87f1b0e6-kserve-97b567b7b-s6mhh"]
Sep 06 01:22:50.048132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.048105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:50.191349 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.191293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:50.478095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.478063    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" path="/var/lib/kubelet/pods/db5c4e1a-b51b-4d21-9c55-1e74df330e04/volumes"
Sep 06 01:22:50.632783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.632671    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:50.730289 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.730154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:22:50.737700 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.737679    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:22:50.738060 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738043    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a12af142-a866-408e-b986-96f172e04476" containerName="main"
Sep 06 01:22:50.738103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738064    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a12af142-a866-408e-b986-96f172e04476" containerName="main"
Sep 06 01:22:50.738103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738091    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" containerName="payload-pre-processing"
Sep 06 01:22:50.738103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738100    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" containerName="payload-pre-processing"
Sep 06 01:22:50.738263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738118    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" containerName="main"
Sep 06 01:22:50.738263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738125    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" containerName="main"
Sep 06 01:22:50.738263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738239    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="db5c4e1a-b51b-4d21-9c55-1e74df330e04" containerName="main"
Sep 06 01:22:50.738263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738247    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a12af142-a866-408e-b986-96f172e04476" containerName="main"
Sep 06 01:22:50.738263 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.738255    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4acc0af3-3825-41d6-b4c2-0439b8b40c8b" containerName="payload-pre-processing"
Sep 06 01:22:50.742694 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.742676    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.745755 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.745737    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-bb49d333-dockercfg-xlnfz\""
Sep 06 01:22:50.745874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.745797    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-bb49d333\""
Sep 06 01:22:50.754352 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.754330    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:22:50.759697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.759676    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:22:50.759818 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.759797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.772429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.772410    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:22:50.813875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.813853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnpfc\" (UniqueName: \"kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.814008 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.813884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qngzb\" (UniqueName: \"kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.814008 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.813974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.814080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.814044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.914642 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.914611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnpfc\" (UniqueName: \"kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.914797 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.914663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qngzb\" (UniqueName: \"kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.914797 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.914738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.914920 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.914810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.915480 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.915461    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.915640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.915620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:50.933021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.926855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnpfc\" (UniqueName: \"kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc\") pod \"payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") " pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:50.936067 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:50.936041    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qngzb\" (UniqueName: \"kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb\") pod \"payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:51.054708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:51.054621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:51.069685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:51.069653    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:51.329655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:51.329627    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:22:51.331193 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:22:51.331154    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a97616e_6080_4ee7_a443_633069531b76.slice/crio-434216b10fcbdb94d1e75f56709788b535c36fd620086f22410b252815ef7790 WatchSource:0}: Error finding container 434216b10fcbdb94d1e75f56709788b535c36fd620086f22410b252815ef7790: Status 404 returned error can't find the container with id 434216b10fcbdb94d1e75f56709788b535c36fd620086f22410b252815ef7790
Sep 06 01:22:51.357255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:51.357233    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:22:51.360451 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:22:51.360421    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d45ad2c_f849_4903_a3da_a5f3cea1e236.slice/crio-93b6cf604c8e8160aeffa56a7530bc5ec549563192f57d0ff3019bb40cead5b6 WatchSource:0}: Error finding container 93b6cf604c8e8160aeffa56a7530bc5ec549563192f57d0ff3019bb40cead5b6: Status 404 returned error can't find the container with id 93b6cf604c8e8160aeffa56a7530bc5ec549563192f57d0ff3019bb40cead5b6
Sep 06 01:22:51.361509 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:51.361488    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" event={"ID":"1a97616e-6080-4ee7-a443-633069531b76","Type":"ContainerStarted","Data":"434216b10fcbdb94d1e75f56709788b535c36fd620086f22410b252815ef7790"}
Sep 06 01:22:52.368090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.368052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" event={"ID":"1a97616e-6080-4ee7-a443-633069531b76","Type":"ContainerStarted","Data":"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"}
Sep 06 01:22:52.368569 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.368157    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:22:52.369683 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.369663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" event={"ID":"3d45ad2c-f849-4903-a3da-a5f3cea1e236","Type":"ContainerStarted","Data":"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"}
Sep 06 01:22:52.369795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.369698    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" event={"ID":"3d45ad2c-f849-4903-a3da-a5f3cea1e236","Type":"ContainerStarted","Data":"93b6cf604c8e8160aeffa56a7530bc5ec549563192f57d0ff3019bb40cead5b6"}
Sep 06 01:22:52.369795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.369779    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:22:52.386312 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.386263    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" podStartSLOduration=2.386249918 podStartE2EDuration="2.386249918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:52.383777444 +0000 UTC m=+802.386259011" watchObservedRunningTime="2026-09-06 01:22:52.386249918 +0000 UTC m=+802.388731480"
Sep 06 01:22:52.403309 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:22:52.403258    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" podStartSLOduration=2.403239625 podStartE2EDuration="2.403239625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:52.400525444 +0000 UTC m=+802.403007012" watchObservedRunningTime="2026-09-06 01:22:52.403239625 +0000 UTC m=+802.405721193"
Sep 06 01:23:00.311456 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:00.311423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:23:01.052817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:01.052784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:01.152751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:01.152722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:03.376874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:03.376844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:23:03.377331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:03.377030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:23:15.780256 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:15.780221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.456064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.456035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.483343 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.483312    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:23:20.483571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.483543    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" podUID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" containerName="payload-processing" containerID="cri-o://fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86" gracePeriod=30
Sep 06 01:23:20.490996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.489920    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:23:20.490996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.490137    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" podUID="1a97616e-6080-4ee7-a443-633069531b76" containerName="payload-pre-processing" containerID="cri-o://c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8" gracePeriod=30
Sep 06 01:23:20.555726 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.555702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.638015 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.637974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.701882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.701856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.792629 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.792609    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:23:20.796003 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.795982    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:23:20.799589 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.799570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:20.900137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900106    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume\") pod \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") "
Sep 06 01:23:20.900137 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900141    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnpfc\" (UniqueName: \"kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc\") pod \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\" (UID: \"3d45ad2c-f849-4903-a3da-a5f3cea1e236\") "
Sep 06 01:23:20.900411 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume\") pod \"1a97616e-6080-4ee7-a443-633069531b76\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") "
Sep 06 01:23:20.900411 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qngzb\" (UniqueName: \"kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb\") pod \"1a97616e-6080-4ee7-a443-633069531b76\" (UID: \"1a97616e-6080-4ee7-a443-633069531b76\") "
Sep 06 01:23:20.900568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a97616e-6080-4ee7-a443-633069531b76" (UID: "1a97616e-6080-4ee7-a443-633069531b76"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:23:20.900568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.900554    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d45ad2c-f849-4903-a3da-a5f3cea1e236" (UID: "3d45ad2c-f849-4903-a3da-a5f3cea1e236"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:23:20.902420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.902397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb" (OuterVolumeSpecName: "kube-api-access-qngzb") pod "1a97616e-6080-4ee7-a443-633069531b76" (UID: "1a97616e-6080-4ee7-a443-633069531b76"). InnerVolumeSpecName "kube-api-access-qngzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:23:20.902517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:20.902501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc" (OuterVolumeSpecName: "kube-api-access-pnpfc") pod "3d45ad2c-f849-4903-a3da-a5f3cea1e236" (UID: "3d45ad2c-f849-4903-a3da-a5f3cea1e236"). InnerVolumeSpecName "kube-api-access-pnpfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:23:21.001371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.001340    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qngzb\" (UniqueName: \"kubernetes.io/projected/1a97616e-6080-4ee7-a443-633069531b76-kube-api-access-qngzb\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:23:21.001371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.001366    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d45ad2c-f849-4903-a3da-a5f3cea1e236-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:23:21.001371 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.001375    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnpfc\" (UniqueName: \"kubernetes.io/projected/3d45ad2c-f849-4903-a3da-a5f3cea1e236-kube-api-access-pnpfc\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:23:21.001590 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.001384    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a97616e-6080-4ee7-a443-633069531b76-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:23:21.495768 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.495734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:21.520505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.520476    2582 generic.go:356] "Generic (PLEG): container finished" podID="1a97616e-6080-4ee7-a443-633069531b76" containerID="c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8" exitCode=0
Sep 06 01:23:21.520649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.520520    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"
Sep 06 01:23:21.520649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.520563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" event={"ID":"1a97616e-6080-4ee7-a443-633069531b76","Type":"ContainerDied","Data":"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"}
Sep 06 01:23:21.520649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.520626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555" event={"ID":"1a97616e-6080-4ee7-a443-633069531b76","Type":"ContainerDied","Data":"434216b10fcbdb94d1e75f56709788b535c36fd620086f22410b252815ef7790"}
Sep 06 01:23:21.520802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.520656    2582 scope.go:117] "RemoveContainer" containerID="c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"
Sep 06 01:23:21.522037 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.522003    2582 generic.go:356] "Generic (PLEG): container finished" podID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" containerID="fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86" exitCode=0
Sep 06 01:23:21.522123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.522057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" event={"ID":"3d45ad2c-f849-4903-a3da-a5f3cea1e236","Type":"ContainerDied","Data":"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"}
Sep 06 01:23:21.522123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.522062    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"
Sep 06 01:23:21.522123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.522094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m" event={"ID":"3d45ad2c-f849-4903-a3da-a5f3cea1e236","Type":"ContainerDied","Data":"93b6cf604c8e8160aeffa56a7530bc5ec549563192f57d0ff3019bb40cead5b6"}
Sep 06 01:23:21.530642 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.530623    2582 scope.go:117] "RemoveContainer" containerID="c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"
Sep 06 01:23:21.530902 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:23:21.530880    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8\": container with ID starting with c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8 not found: ID does not exist" containerID="c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"
Sep 06 01:23:21.530973 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.530914    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8"} err="failed to get container status \"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8\": rpc error: code = NotFound desc = could not find container \"c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8\": container with ID starting with c21afd854dbd7a2065167986bef28c5ce0bad96f5abf31d36331a1f2570c6fa8 not found: ID does not exist"
Sep 06 01:23:21.530973 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.530939    2582 scope.go:117] "RemoveContainer" containerID="fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"
Sep 06 01:23:21.541539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.541525    2582 scope.go:117] "RemoveContainer" containerID="fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"
Sep 06 01:23:21.541796 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:23:21.541782    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86\": container with ID starting with fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86 not found: ID does not exist" containerID="fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"
Sep 06 01:23:21.541832 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.541802    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86"} err="failed to get container status \"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86\": rpc error: code = NotFound desc = could not find container \"fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86\": container with ID starting with fe3ee8104e028b5ba6968ed2b22e73816ad6ef2491d7666a6e2de7ea85ae6e86 not found: ID does not exist"
Sep 06 01:23:21.545854 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.545835    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:23:21.551657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.551638    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bb49d333-685b9598cd-mt555"]
Sep 06 01:23:21.561468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.561448    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:23:21.565814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.565795    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bb49d333-f8c47d697-jkx4m"]
Sep 06 01:23:21.568272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.568253    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:21.631287 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:21.631263    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:22.003788 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:22.003753    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:23:22.477308 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:22.477276    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a97616e-6080-4ee7-a443-633069531b76" path="/var/lib/kubelet/pods/1a97616e-6080-4ee7-a443-633069531b76/volumes"
Sep 06 01:23:22.477642 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:22.477629    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" path="/var/lib/kubelet/pods/3d45ad2c-f849-4903-a3da-a5f3cea1e236/volumes"
Sep 06 01:23:23.131071 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:23.131040    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:28.532092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532058    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:23:28.532580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532508    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a97616e-6080-4ee7-a443-633069531b76" containerName="payload-pre-processing"
Sep 06 01:23:28.532580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a97616e-6080-4ee7-a443-633069531b76" containerName="payload-pre-processing"
Sep 06 01:23:28.532580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" containerName="payload-processing"
Sep 06 01:23:28.532580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532550    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" containerName="payload-processing"
Sep 06 01:23:28.532790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532648    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d45ad2c-f849-4903-a3da-a5f3cea1e236" containerName="payload-processing"
Sep 06 01:23:28.532790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.532665    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a97616e-6080-4ee7-a443-633069531b76" containerName="payload-pre-processing"
Sep 06 01:23:28.534959 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.534943    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.538430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.538406    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b217a\"/\"openshift-service-ca.crt\""
Sep 06 01:23:28.538573 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.538448    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b217a\"/\"default-dockercfg-tlpgd\""
Sep 06 01:23:28.538573 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.538462    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4b217a\"/\"test-model-4b217a-kserve-self-signed-certs\""
Sep 06 01:23:28.538573 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.538509    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4b217a\"/\"kube-root-ca.crt\""
Sep 06 01:23:28.547999 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.547980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:23:28.561495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.561460    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:28.672080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.672080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fk85\" (UniqueName: \"kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.672268 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.672268 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.672344 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.672376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.672337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fk85\" (UniqueName: \"kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773612 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773710 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.773879 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.773857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.775677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.775659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.776056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.776036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.781765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.781746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fk85\" (UniqueName: \"kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85\") pod \"test-model-4b217a-kserve-677c947995-4xhxt\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") " pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:28.844339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:28.844277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:29.014111 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.014080    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:29.076919 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.076890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:29.121544 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.121523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:23:29.123254 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:23:29.123221    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8804ef94_21a1_470d_9843_f9ba24b009a0.slice/crio-0321b0a34fbdeff49fa30a543b7d8e1fd2f52633473cf95c67f8f763b7b9118f WatchSource:0}: Error finding container 0321b0a34fbdeff49fa30a543b7d8e1fd2f52633473cf95c67f8f763b7b9118f: Status 404 returned error can't find the container with id 0321b0a34fbdeff49fa30a543b7d8e1fd2f52633473cf95c67f8f763b7b9118f
Sep 06 01:23:29.167990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.167972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:29.252195 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.252141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:29.315717 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.315688    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:29.564757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.564678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" event={"ID":"8804ef94-21a1-470d-9843-f9ba24b009a0","Type":"ContainerStarted","Data":"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"}
Sep 06 01:23:29.564757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.564719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" event={"ID":"8804ef94-21a1-470d-9843-f9ba24b009a0","Type":"ContainerStarted","Data":"0321b0a34fbdeff49fa30a543b7d8e1fd2f52633473cf95c67f8f763b7b9118f"}
Sep 06 01:23:29.583372 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.583320    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" podStartSLOduration=1.58330577 podStartE2EDuration="1.58330577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:23:29.581883757 +0000 UTC m=+839.584365323" watchObservedRunningTime="2026-09-06 01:23:29.58330577 +0000 UTC m=+839.585787345"
Sep 06 01:23:29.760652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:29.760606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:33.811446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:33.811403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:23:38.845246 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:38.845212    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:38.845727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:38.845260    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:38.857552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:38.857528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:39.625855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:39.625826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:23:49.107420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:49.102012    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:23:50.316811 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:50.316785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:50.416831 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:50.416794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:52.030958 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:52.030926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:23:55.700634 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:23:55.700604    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:01.485343 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:01.485307    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:01.551742 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:01.551710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:01.625912 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:01.625883    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:01.724385 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:01.724356    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:02.696088 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:02.696053    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:24:10.524109 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:10.524060    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:24:10.572914 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:10.572874    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:13.301589 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:13.301558    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:24:15.010374 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:15.010328    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:15.105471 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:15.105439    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:17.505822 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:17.505781    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:21.158669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:21.158633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:21.218873 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:21.218837    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:21.319420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:21.319319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:21.420563 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:21.420476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:21.695093 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:21.695010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:23.314827 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:23.314794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:23.425843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:23.425812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:23.515459 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:23.515434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:25.543681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.543641    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" podUID="b55ace7c-afe1-471e-8527-e99bbc9500a6" containerName="main" containerID="cri-o://b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11" gracePeriod=45
Sep 06 01:24:25.790877 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.790855    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:24:25.837602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.837535    2582 generic.go:356] "Generic (PLEG): container finished" podID="b55ace7c-afe1-471e-8527-e99bbc9500a6" containerID="b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11" exitCode=0
Sep 06 01:24:25.837602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.837576    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"
Sep 06 01:24:25.837757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.837616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" event={"ID":"b55ace7c-afe1-471e-8527-e99bbc9500a6","Type":"ContainerDied","Data":"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"}
Sep 06 01:24:25.837757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.837655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw" event={"ID":"b55ace7c-afe1-471e-8527-e99bbc9500a6","Type":"ContainerDied","Data":"6ded08a717aae3772b3737d84eab82a4e64eecd838b5bcb6c05964b186341739"}
Sep 06 01:24:25.837757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.837672    2582 scope.go:117] "RemoveContainer" containerID="b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"
Sep 06 01:24:25.846284 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.846266    2582 scope.go:117] "RemoveContainer" containerID="b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"
Sep 06 01:24:25.846546 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:24:25.846529    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11\": container with ID starting with b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11 not found: ID does not exist" containerID="b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"
Sep 06 01:24:25.846592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.846555    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11"} err="failed to get container status \"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11\": rpc error: code = NotFound desc = could not find container \"b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11\": container with ID starting with b7d5c529f795fbda4ae03641401af9dc729c81fbd925866a8f06e829cbbe3f11 not found: ID does not exist"
Sep 06 01:24:25.895438 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895420    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895449    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdvc7\" (UniqueName: \"kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895589    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs\") pod \"b55ace7c-afe1-471e-8527-e99bbc9500a6\" (UID: \"b55ace7c-afe1-471e-8527-e99bbc9500a6\") "
Sep 06 01:24:25.895795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895695    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home" (OuterVolumeSpecName: "home") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:25.895795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:25.895885 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895834    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:25.895932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895921    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:25.895969 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895939    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:25.895969 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.895967    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:25.897868 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.897833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm" (OuterVolumeSpecName: "dshm") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:25.897956 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.897912    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:24:25.897956 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.897932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7" (OuterVolumeSpecName: "kube-api-access-hdvc7") pod "b55ace7c-afe1-471e-8527-e99bbc9500a6" (UID: "b55ace7c-afe1-471e-8527-e99bbc9500a6"). InnerVolumeSpecName "kube-api-access-hdvc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:25.993875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.993841    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:24:25.996705 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.996679    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b55ace7c-afe1-471e-8527-e99bbc9500a6-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:25.996821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.996708    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdvc7\" (UniqueName: \"kubernetes.io/projected/b55ace7c-afe1-471e-8527-e99bbc9500a6-kube-api-access-hdvc7\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:25.996821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:25.996721    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b55ace7c-afe1-471e-8527-e99bbc9500a6-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:26.161005 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:26.160977    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:24:26.164542 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:26.164522    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-20c535/autores-model-20c535-kserve-8596689879-j8vmw"]
Sep 06 01:24:26.477523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:26.477451    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b55ace7c-afe1-471e-8527-e99bbc9500a6" path="/var/lib/kubelet/pods/b55ace7c-afe1-471e-8527-e99bbc9500a6/volumes"
Sep 06 01:24:27.639081 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:27.639050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:27.696512 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:27.696487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:27.894623 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:27.894546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:28.457438 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:28.457408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:28.776393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:28.776284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:28.874806 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:28.874778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:29.206873 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:29.206835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:30.466805 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:30.466775    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:24:30.468504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:30.468485    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:24:32.182648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:32.182614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:32.277687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:32.277656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:33.322065 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.322037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:33.479328 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.479293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:33.784025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.783997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:33.869870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.869836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:33.905761 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.905734    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:24:33.906115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.906101    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b55ace7c-afe1-471e-8527-e99bbc9500a6" containerName="main"
Sep 06 01:24:33.906115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.906114    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b55ace7c-afe1-471e-8527-e99bbc9500a6" containerName="main"
Sep 06 01:24:33.906294 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.906217    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b55ace7c-afe1-471e-8527-e99bbc9500a6" containerName="main"
Sep 06 01:24:33.910147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.910111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:33.915632 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.915613    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-109eb6\""
Sep 06 01:24:33.915749 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.915662    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-109eb6-dockercfg-wng2z\""
Sep 06 01:24:33.922149 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.922128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:24:33.977688 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.977662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mvr8\" (UniqueName: \"kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:33.977804 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:33.977721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.078631 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.078545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.078781 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.078630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mvr8\" (UniqueName: \"kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.079272 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.079253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.085377 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.085354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:34.087410 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.087388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mvr8\" (UniqueName: \"kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8\") pod \"payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") " pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.220960 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.220925    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.497840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.497653    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:24:34.500262 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:24:34.500234    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe1e279a_a151_4849_ab4b_e6ea9974a6cb.slice/crio-4104b9be9cbadc25d16df4bc253543f190f9d7abff15edd486f333a5c07682ed WatchSource:0}: Error finding container 4104b9be9cbadc25d16df4bc253543f190f9d7abff15edd486f333a5c07682ed: Status 404 returned error can't find the container with id 4104b9be9cbadc25d16df4bc253543f190f9d7abff15edd486f333a5c07682ed
Sep 06 01:24:34.883464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.883431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" event={"ID":"fe1e279a-a151-4849-ab4b-e6ea9974a6cb","Type":"ContainerStarted","Data":"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"}
Sep 06 01:24:34.883641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.883494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" event={"ID":"fe1e279a-a151-4849-ab4b-e6ea9974a6cb","Type":"ContainerStarted","Data":"4104b9be9cbadc25d16df4bc253543f190f9d7abff15edd486f333a5c07682ed"}
Sep 06 01:24:34.883641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.883627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:34.904132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.904081    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" podStartSLOduration=1.904062065 podStartE2EDuration="1.904062065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:34.902593483 +0000 UTC m=+904.905075054" watchObservedRunningTime="2026-09-06 01:24:34.904062065 +0000 UTC m=+904.906543630"
Sep 06 01:24:34.942796 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:34.942751    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:35.325895 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:35.325816    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:24:35.340411 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:35.340382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:36.631496 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:36.631459    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:24:36.652389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:36.652363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:39.498567 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:39.498530    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:24:40.928461 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:40.928419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:41.034458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:41.034428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:41.131061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:41.131025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:41.225778 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:41.225693    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:41.861870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:41.861835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:41.963172 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:41.963134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:42.063408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:42.063379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:43.558161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:43.558115    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:45.890764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:45.890734    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:24:47.310892 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:47.310866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:47.380610 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:47.380573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:47.442092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:47.442060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:47.498345 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:47.498318    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:47.850201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:47.850151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:49.315818 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:49.315771    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:49.415803 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:49.415773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:50.004928 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.004876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:50.347947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.347869    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" podUID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" containerName="main" containerID="cri-o://f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9" gracePeriod=45
Sep 06 01:24:50.598500 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.598439    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:24:50.736189 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736147    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736210    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736231    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736264    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736382 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrwqg\" (UniqueName: \"kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736413    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs\") pod \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\" (UID: \"787387e8-e8ed-4309-ba69-9fe3dee5b6f3\") "
Sep 06 01:24:50.736615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736456    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home" (OuterVolumeSpecName: "home") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:50.736615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:50.736757 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736640    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:50.736825 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736775    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.736825 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736795    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.736825 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.736808    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.738777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.738748    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:24:50.738888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.738804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg" (OuterVolumeSpecName: "kube-api-access-qrwqg") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "kube-api-access-qrwqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:50.738888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.738839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm" (OuterVolumeSpecName: "dshm") pod "787387e8-e8ed-4309-ba69-9fe3dee5b6f3" (UID: "787387e8-e8ed-4309-ba69-9fe3dee5b6f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:50.838444 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.838410    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.838444 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.838441    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.838643 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.838454    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrwqg\" (UniqueName: \"kubernetes.io/projected/787387e8-e8ed-4309-ba69-9fe3dee5b6f3-kube-api-access-qrwqg\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:50.963201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.963144    2582 generic.go:356] "Generic (PLEG): container finished" podID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" containerID="f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9" exitCode=0
Sep 06 01:24:50.963365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.963205    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"
Sep 06 01:24:50.963365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.963231    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" event={"ID":"787387e8-e8ed-4309-ba69-9fe3dee5b6f3","Type":"ContainerDied","Data":"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"}
Sep 06 01:24:50.963365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.963275    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz" event={"ID":"787387e8-e8ed-4309-ba69-9fe3dee5b6f3","Type":"ContainerDied","Data":"857bf99e0ae4d5cae1f86f97b4731ca631cd9dd1fc5cb2dab3007a55c980ef07"}
Sep 06 01:24:50.963365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.963291    2582 scope.go:117] "RemoveContainer" containerID="f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"
Sep 06 01:24:50.974703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.974685    2582 scope.go:117] "RemoveContainer" containerID="f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"
Sep 06 01:24:50.974989 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:24:50.974970    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9\": container with ID starting with f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9 not found: ID does not exist" containerID="f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"
Sep 06 01:24:50.975059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.975002    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9"} err="failed to get container status \"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9\": rpc error: code = NotFound desc = could not find container \"f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9\": container with ID starting with f26ed55dcbf66b639e07899c9eaff5cd92cc02cb5379da4d39abec19a3ee5ff9 not found: ID does not exist"
Sep 06 01:24:50.985168 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.985146    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:24:50.989815 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:50.989794    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b63fa0/test-model-b63fa0-kserve-585d7fbf65-zgcjz"]
Sep 06 01:24:51.652771 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.652727    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" podUID="8804ef94-21a1-470d-9843-f9ba24b009a0" containerName="main" containerID="cri-o://5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8" gracePeriod=45
Sep 06 01:24:51.893426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.893402    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:24:51.946691 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946627    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.946691 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.946875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.946875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fk85\" (UniqueName: \"kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.946875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.946875 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946814    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache\") pod \"8804ef94-21a1-470d-9843-f9ba24b009a0\" (UID: \"8804ef94-21a1-470d-9843-f9ba24b009a0\") "
Sep 06 01:24:51.947061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home" (OuterVolumeSpecName: "home") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:51.947061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.946974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:51.947175 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.947126    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:51.947175 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.947132    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:51.947175 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.947144    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:51.949068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.949045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm" (OuterVolumeSpecName: "dshm") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:51.949068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.949053    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:24:51.949068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.949050    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85" (OuterVolumeSpecName: "kube-api-access-2fk85") pod "8804ef94-21a1-470d-9843-f9ba24b009a0" (UID: "8804ef94-21a1-470d-9843-f9ba24b009a0"). InnerVolumeSpecName "kube-api-access-2fk85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:51.969509 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.969483    2582 generic.go:356] "Generic (PLEG): container finished" podID="8804ef94-21a1-470d-9843-f9ba24b009a0" containerID="5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8" exitCode=0
Sep 06 01:24:51.969593 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.969528    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"
Sep 06 01:24:51.969593 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.969526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" event={"ID":"8804ef94-21a1-470d-9843-f9ba24b009a0","Type":"ContainerDied","Data":"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"}
Sep 06 01:24:51.969593 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.969574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt" event={"ID":"8804ef94-21a1-470d-9843-f9ba24b009a0","Type":"ContainerDied","Data":"0321b0a34fbdeff49fa30a543b7d8e1fd2f52633473cf95c67f8f763b7b9118f"}
Sep 06 01:24:51.969731 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.969598    2582 scope.go:117] "RemoveContainer" containerID="5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"
Sep 06 01:24:51.978125 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.978107    2582 scope.go:117] "RemoveContainer" containerID="5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"
Sep 06 01:24:51.978439 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:24:51.978411    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8\": container with ID starting with 5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8 not found: ID does not exist" containerID="5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"
Sep 06 01:24:51.978506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.978439    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8"} err="failed to get container status \"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8\": rpc error: code = NotFound desc = could not find container \"5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8\": container with ID starting with 5910a9280b1c36bfa26b5bf5ccbc4fb141ea146e380baec35998662d2e190eb8 not found: ID does not exist"
Sep 06 01:24:51.990696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.990675    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:24:51.996483 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:51.996463    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4b217a/test-model-4b217a-kserve-677c947995-4xhxt"]
Sep 06 01:24:52.048251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.048228    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:52.048251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.048250    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fk85\" (UniqueName: \"kubernetes.io/projected/8804ef94-21a1-470d-9843-f9ba24b009a0-kube-api-access-2fk85\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:52.048407 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.048259    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8804ef94-21a1-470d-9843-f9ba24b009a0-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:52.048407 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.048270    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8804ef94-21a1-470d-9843-f9ba24b009a0-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:24:52.477233 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.477201    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" path="/var/lib/kubelet/pods/787387e8-e8ed-4309-ba69-9fe3dee5b6f3/volumes"
Sep 06 01:24:52.477599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:52.477586    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8804ef94-21a1-470d-9843-f9ba24b009a0" path="/var/lib/kubelet/pods/8804ef94-21a1-470d-9843-f9ba24b009a0/volumes"
Sep 06 01:24:53.104414 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:53.104382    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:24:53.664806 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:53.664774    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:53.765216 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:53.765167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:53.931109 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:53.931027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:56.253474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:56.253429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:56.354114 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:56.354072    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:56.499613 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:56.499582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:56.809205 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:56.809163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:57.074650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:57.074534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:24:57.175891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:24:57.175861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:00.276095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:00.276065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:00.357942 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:00.357913    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:01.534772 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:01.534728    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:01.634126 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:01.634081    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:01.971066 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:01.971038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:02.071144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:02.071114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:05.059249 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.059216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:05.095639 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.095612    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:25:05.095859 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.095833    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" podUID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" containerName="payload-pre-processing" containerID="cri-o://31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6" gracePeriod=30
Sep 06 01:25:05.100650 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.100622    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:25:05.157645 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.157618    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:05.258076 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.258046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:05.331337 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.331309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:05.340279 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.340259    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:25:05.466685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.466656    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvdxz\" (UniqueName: \"kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz\") pod \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") "
Sep 06 01:25:05.466904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.466719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume\") pod \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\" (UID: \"ae7ab164-3425-48aa-87f5-475fc6c4a5b1\") "
Sep 06 01:25:05.467140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.467112    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae7ab164-3425-48aa-87f5-475fc6c4a5b1" (UID: "ae7ab164-3425-48aa-87f5-475fc6c4a5b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:05.468910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.468884    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz" (OuterVolumeSpecName: "kube-api-access-nvdxz") pod "ae7ab164-3425-48aa-87f5-475fc6c4a5b1" (UID: "ae7ab164-3425-48aa-87f5-475fc6c4a5b1"). InnerVolumeSpecName "kube-api-access-nvdxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:05.567988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.567943    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvdxz\" (UniqueName: \"kubernetes.io/projected/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-kube-api-access-nvdxz\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.567988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.567986    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae7ab164-3425-48aa-87f5-475fc6c4a5b1-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.630261 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:05.630228    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:06.038749 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.038670    2582 generic.go:356] "Generic (PLEG): container finished" podID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" containerID="31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6" exitCode=0
Sep 06 01:25:06.038749 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.038707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" event={"ID":"ae7ab164-3425-48aa-87f5-475fc6c4a5b1","Type":"ContainerDied","Data":"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"}
Sep 06 01:25:06.038948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.038760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4" event={"ID":"ae7ab164-3425-48aa-87f5-475fc6c4a5b1","Type":"ContainerDied","Data":"28e7e7469710fb5e17916cb5aff80587d71eb9474f45ff43e213df583b4d4c47"}
Sep 06 01:25:06.038948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.038718    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"
Sep 06 01:25:06.038948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.038782    2582 scope.go:117] "RemoveContainer" containerID="31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"
Sep 06 01:25:06.054966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.054946    2582 scope.go:117] "RemoveContainer" containerID="31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"
Sep 06 01:25:06.055309 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:25:06.055289    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6\": container with ID starting with 31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6 not found: ID does not exist" containerID="31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"
Sep 06 01:25:06.055365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.055319    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6"} err="failed to get container status \"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6\": rpc error: code = NotFound desc = could not find container \"31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6\": container with ID starting with 31ebe33c3fbca874866562c9e9e6d708d56a806dcbf73648b7af6903a38de1d6 not found: ID does not exist"
Sep 06 01:25:06.063542 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.063520    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:25:06.066393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.066374    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-4b217a-694bc586c4-pq9d4"]
Sep 06 01:25:06.476812 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:06.476778    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" path="/var/lib/kubelet/pods/ae7ab164-3425-48aa-87f5-475fc6c4a5b1/volumes"
Sep 06 01:25:11.489871 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:11.489840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:11.551727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:11.551690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:11.740408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:11.740331    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:12.320061 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.320027    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:12.535240 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535210    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:12.535640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535599    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" containerName="payload-pre-processing"
Sep 06 01:25:12.535640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535615    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" containerName="payload-pre-processing"
Sep 06 01:25:12.535640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535639    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" containerName="main"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535645    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" containerName="main"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535655    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8804ef94-21a1-470d-9843-f9ba24b009a0" containerName="main"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8804ef94-21a1-470d-9843-f9ba24b009a0" containerName="main"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535715    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8804ef94-21a1-470d-9843-f9ba24b009a0" containerName="main"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535724    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7ab164-3425-48aa-87f5-475fc6c4a5b1" containerName="payload-pre-processing"
Sep 06 01:25:12.535823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.535732    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="787387e8-e8ed-4309-ba69-9fe3dee5b6f3" containerName="main"
Sep 06 01:25:12.539899 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.539879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.542427 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.542409    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-109eb6\"/\"kube-root-ca.crt\""
Sep 06 01:25:12.543557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.543541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-109eb6\"/\"openshift-service-ca.crt\""
Sep 06 01:25:12.543608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.543569    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-109eb6\"/\"explicit-model-109eb6-kserve-self-signed-certs\""
Sep 06 01:25:12.543651 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.543541    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-109eb6\"/\"default-dockercfg-ccn22\""
Sep 06 01:25:12.553919 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.553899    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:12.567922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.567900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:12.633830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.633990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.633990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.633990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.633990 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7r6\" (UniqueName: \"kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.634264 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.633993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.644027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.644008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:12.734943 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.734915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.734973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7r6\" (UniqueName: \"kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735248 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735377 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735354    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.735569 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.735548    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.737514 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.737492    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.737748 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.737734    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.743564 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.743547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7r6\" (UniqueName: \"kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6\") pod \"explicit-model-109eb6-kserve-78b546dc67-rj7v7\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") " pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:12.849545 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:12.849514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:13.085697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:13.085563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:13.121281 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:13.121209    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:13.123621 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:25:13.123597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42bb45a4_fa31_43ed_84f5_d7f3d0b4bf5c.slice/crio-ffdb7415d55d598c1dc42dba398061e0f5aaaff2e71d376f0f960377d0bf26c7 WatchSource:0}: Error finding container ffdb7415d55d598c1dc42dba398061e0f5aaaff2e71d376f0f960377d0bf26c7: Status 404 returned error can't find the container with id ffdb7415d55d598c1dc42dba398061e0f5aaaff2e71d376f0f960377d0bf26c7
Sep 06 01:25:14.083152 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:14.083111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" event={"ID":"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c","Type":"ContainerStarted","Data":"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"}
Sep 06 01:25:14.083618 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:14.083160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" event={"ID":"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c","Type":"ContainerStarted","Data":"ffdb7415d55d598c1dc42dba398061e0f5aaaff2e71d376f0f960377d0bf26c7"}
Sep 06 01:25:14.102802 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:14.102757    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" podStartSLOduration=2.10274174 podStartE2EDuration="2.10274174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:14.100858469 +0000 UTC m=+944.103340036" watchObservedRunningTime="2026-09-06 01:25:14.10274174 +0000 UTC m=+944.105223306"
Sep 06 01:25:15.364947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.364909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:15.545209 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.545164    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:15.651561 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.651536    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"]
Sep 06 01:25:15.655103 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.655070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:15.657668 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.657647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:25:15.657780 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.657665    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:25:15.660852 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.660825    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx\" (UID: \"e1c6c174-f496-4ca4-a0e7-be4a4e901b74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:15.663430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.663411    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"]
Sep 06 01:25:15.761413 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.761383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx\" (UID: \"e1c6c174-f496-4ca4-a0e7-be4a4e901b74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:15.761956 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.761936    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx\" (UID: \"e1c6c174-f496-4ca4-a0e7-be4a4e901b74\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:15.967283 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:15.967211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:16.260740 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:16.260717    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"]
Sep 06 01:25:16.262327 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:25:16.262300    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c6c174_f496_4ca4_a0e7_be4a4e901b74.slice/crio-4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde WatchSource:0}: Error finding container 4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde: Status 404 returned error can't find the container with id 4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde
Sep 06 01:25:16.744592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:16.744532    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:16.910696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:16.910670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:17.098699 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:17.098667    2582 generic.go:356] "Generic (PLEG): container finished" podID="e1c6c174-f496-4ca4-a0e7-be4a4e901b74" containerID="8c048683f953e8c0e80dedd8302c4b3811e3d981a7f7cfd5577be1e089e0ea34" exitCode=0
Sep 06 01:25:17.098824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:17.098737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx" event={"ID":"e1c6c174-f496-4ca4-a0e7-be4a4e901b74","Type":"ContainerDied","Data":"8c048683f953e8c0e80dedd8302c4b3811e3d981a7f7cfd5577be1e089e0ea34"}
Sep 06 01:25:17.098824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:17.098776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx" event={"ID":"e1c6c174-f496-4ca4-a0e7-be4a4e901b74","Type":"ContainerStarted","Data":"4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde"}
Sep 06 01:25:17.215401 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:17.215330    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:17.314289 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:17.314252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:18.231892 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:18.231865    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:18.287039 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:18.287012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca\") pod \"e1c6c174-f496-4ca4-a0e7-be4a4e901b74\" (UID: \"e1c6c174-f496-4ca4-a0e7-be4a4e901b74\") "
Sep 06 01:25:18.287412 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:18.287391    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1c6c174-f496-4ca4-a0e7-be4a4e901b74" (UID: "e1c6c174-f496-4ca4-a0e7-be4a4e901b74"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:18.387753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:18.387724    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1c6c174-f496-4ca4-a0e7-be4a4e901b74-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:19.110907 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:19.110883    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"
Sep 06 01:25:19.111073 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:19.110883    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx" event={"ID":"e1c6c174-f496-4ca4-a0e7-be4a4e901b74","Type":"ContainerDied","Data":"4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde"}
Sep 06 01:25:19.111073 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:19.110999    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c914dd5b8f5a163e19040fb812faa493d4f0e6591a06cf8a9c1b322ecab9cde"
Sep 06 01:25:22.300936 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:22.300900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:25:22.850116 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:22.850083    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:25.251361 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:25.251330    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:25.941788 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:25.941754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.041976 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.041938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.388904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.388879    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.572854 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.572821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.610117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.610084    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:25:26.610353 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.610310    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" podUID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" containerName="payload-processing" containerID="cri-o://32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5" gracePeriod=30
Sep 06 01:25:26.672958 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.672889    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.775093 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.775033    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.781925 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.781904    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"]
Sep 06 01:25:26.786238 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.786214    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-109eb6-mxnjx"]
Sep 06 01:25:26.852995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.852970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:26.856477 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.856458    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:25:26.960419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.960344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mvr8\" (UniqueName: \"kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8\") pod \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") "
Sep 06 01:25:26.960592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.960441    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume\") pod \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\" (UID: \"fe1e279a-a151-4849-ab4b-e6ea9974a6cb\") "
Sep 06 01:25:26.960794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.960773    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe1e279a-a151-4849-ab4b-e6ea9974a6cb" (UID: "fe1e279a-a151-4849-ab4b-e6ea9974a6cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:26.962615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:26.962594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8" (OuterVolumeSpecName: "kube-api-access-4mvr8") pod "fe1e279a-a151-4849-ab4b-e6ea9974a6cb" (UID: "fe1e279a-a151-4849-ab4b-e6ea9974a6cb"). InnerVolumeSpecName "kube-api-access-4mvr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:27.061933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.061904    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mvr8\" (UniqueName: \"kubernetes.io/projected/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-kube-api-access-4mvr8\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:27.061933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.061930    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe1e279a-a151-4849-ab4b-e6ea9974a6cb-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:27.151996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.151964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:27.152212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.152173    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" containerID="32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5" exitCode=0
Sep 06 01:25:27.152274 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.152232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"
Sep 06 01:25:27.152326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.152273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" event={"ID":"fe1e279a-a151-4849-ab4b-e6ea9974a6cb","Type":"ContainerDied","Data":"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"}
Sep 06 01:25:27.152326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.152318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf" event={"ID":"fe1e279a-a151-4849-ab4b-e6ea9974a6cb","Type":"ContainerDied","Data":"4104b9be9cbadc25d16df4bc253543f190f9d7abff15edd486f333a5c07682ed"}
Sep 06 01:25:27.152404 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.152339    2582 scope.go:117] "RemoveContainer" containerID="32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"
Sep 06 01:25:27.163847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.162881    2582 scope.go:117] "RemoveContainer" containerID="32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"
Sep 06 01:25:27.164219 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:25:27.164191    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5\": container with ID starting with 32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5 not found: ID does not exist" containerID="32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"
Sep 06 01:25:27.164316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.164224    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5"} err="failed to get container status \"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5\": rpc error: code = NotFound desc = could not find container \"32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5\": container with ID starting with 32f67ccec4ef2ee16f44301fa1d3100c9d239199b45bde4855ffe25cf3c61fb5 not found: ID does not exist"
Sep 06 01:25:27.174163 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.174138    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:25:27.177106 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:27.177081    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-109eb6-9846d85bf-f62qf"]
Sep 06 01:25:28.477731 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:28.477697    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1c6c174-f496-4ca4-a0e7-be4a4e901b74" path="/var/lib/kubelet/pods/e1c6c174-f496-4ca4-a0e7-be4a4e901b74/volumes"
Sep 06 01:25:28.478139 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:28.478047    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" path="/var/lib/kubelet/pods/fe1e279a-a151-4849-ab4b-e6ea9974a6cb/volumes"
Sep 06 01:25:31.112553 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.112493    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" podUID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" containerName="main" containerID="cri-o://452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7" gracePeriod=45
Sep 06 01:25:31.369506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.369485    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:31.503575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503548    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.503751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503620    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.503751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.503751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj7r6\" (UniqueName: \"kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.503751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.503751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503740    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache\") pod \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\" (UID: \"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c\") "
Sep 06 01:25:31.504028 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home" (OuterVolumeSpecName: "home") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:31.504028 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.503950    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:31.504107 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.504040    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache" (OuterVolumeSpecName: "model-cache") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:31.505910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.505890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:31.505985 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.505945    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6" (OuterVolumeSpecName: "kube-api-access-xj7r6") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "kube-api-access-xj7r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:31.505985 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.505974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm" (OuterVolumeSpecName: "dshm") pod "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" (UID: "42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:31.604557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604481    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:31.604557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604504    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:31.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604622    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj7r6\" (UniqueName: \"kubernetes.io/projected/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-kube-api-access-xj7r6\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:31.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604741    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:31.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604762    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:31.604784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:31.604782    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:32.186445 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.186416    2582 generic.go:356] "Generic (PLEG): container finished" podID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" containerID="452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7" exitCode=0
Sep 06 01:25:32.186857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.186460    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"
Sep 06 01:25:32.186857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.186491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" event={"ID":"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c","Type":"ContainerDied","Data":"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"}
Sep 06 01:25:32.186857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.186530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7" event={"ID":"42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c","Type":"ContainerDied","Data":"ffdb7415d55d598c1dc42dba398061e0f5aaaff2e71d376f0f960377d0bf26c7"}
Sep 06 01:25:32.186857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.186546    2582 scope.go:117] "RemoveContainer" containerID="452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"
Sep 06 01:25:32.196255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.196236    2582 scope.go:117] "RemoveContainer" containerID="452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"
Sep 06 01:25:32.196551 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:25:32.196522    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7\": container with ID starting with 452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7 not found: ID does not exist" containerID="452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"
Sep 06 01:25:32.196622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.196563    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7"} err="failed to get container status \"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7\": rpc error: code = NotFound desc = could not find container \"452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7\": container with ID starting with 452b985fc46a9b58618ea55c4a29746fe43ecc2d20077d1a597ed2507f05d5d7 not found: ID does not exist"
Sep 06 01:25:32.207741 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.207718    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:32.210864 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.210832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:32.212164 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.212145    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-109eb6/explicit-model-109eb6-kserve-78b546dc67-rj7v7"]
Sep 06 01:25:32.268174 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.268145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:32.481701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.481623    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" path="/var/lib/kubelet/pods/42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c/volumes"
Sep 06 01:25:32.616398 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616364    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"]
Sep 06 01:25:32.616732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616719    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c6c174-f496-4ca4-a0e7-be4a4e901b74" containerName="revoke-keys"
Sep 06 01:25:32.616790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616734    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c6c174-f496-4ca4-a0e7-be4a4e901b74" containerName="revoke-keys"
Sep 06 01:25:32.616790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616746    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" containerName="payload-processing"
Sep 06 01:25:32.616790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616751    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" containerName="payload-processing"
Sep 06 01:25:32.616790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616764    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" containerName="main"
Sep 06 01:25:32.616790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616769    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" containerName="main"
Sep 06 01:25:32.616992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616825    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="42bb45a4-fa31-43ed-84f5-d7f3d0b4bf5c" containerName="main"
Sep 06 01:25:32.616992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616833    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1e279a-a151-4849-ab4b-e6ea9974a6cb" containerName="payload-processing"
Sep 06 01:25:32.616992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.616841    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c6c174-f496-4ca4-a0e7-be4a4e901b74" containerName="revoke-keys"
Sep 06 01:25:32.621354 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.621338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:32.623819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.623794    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:25:32.623819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.623813    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:25:32.627623 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.627604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"]
Sep 06 01:25:32.713727 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.713698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv\" (UID: \"815697d5-0ba2-49a2-8c70-6b33199749e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:32.814640 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.814553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv\" (UID: \"815697d5-0ba2-49a2-8c70-6b33199749e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:32.815150 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.815128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv\" (UID: \"815697d5-0ba2-49a2-8c70-6b33199749e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:32.933602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:32.933570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:33.202433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:33.202403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"]
Sep 06 01:25:33.205606 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:25:33.205581    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815697d5_0ba2_49a2_8c70_6b33199749e6.slice/crio-1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650 WatchSource:0}: Error finding container 1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650: Status 404 returned error can't find the container with id 1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650
Sep 06 01:25:33.819450 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:33.819419    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:33.919280 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:33.919254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:34.112020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.111948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:34.199162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.199129    2582 generic.go:356] "Generic (PLEG): container finished" podID="815697d5-0ba2-49a2-8c70-6b33199749e6" containerID="b862900ed01e4c867d3841989f0bf15e65fe98881ab70147ac3980a13b0062ff" exitCode=0
Sep 06 01:25:34.199354 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.199216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv" event={"ID":"815697d5-0ba2-49a2-8c70-6b33199749e6","Type":"ContainerDied","Data":"b862900ed01e4c867d3841989f0bf15e65fe98881ab70147ac3980a13b0062ff"}
Sep 06 01:25:34.199354 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.199268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv" event={"ID":"815697d5-0ba2-49a2-8c70-6b33199749e6","Type":"ContainerStarted","Data":"1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650"}
Sep 06 01:25:34.557616 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.557577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:34.865704 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.865639    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:34.967226 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:34.967198    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:35.328899 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:35.328875    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:35.438037 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:35.438014    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca\") pod \"815697d5-0ba2-49a2-8c70-6b33199749e6\" (UID: \"815697d5-0ba2-49a2-8c70-6b33199749e6\") "
Sep 06 01:25:35.438372 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:35.438351    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "815697d5-0ba2-49a2-8c70-6b33199749e6" (UID: "815697d5-0ba2-49a2-8c70-6b33199749e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:35.539271 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:35.539168    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/815697d5-0ba2-49a2-8c70-6b33199749e6-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:25:35.949334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:35.949308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:36.043408 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:36.043374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:36.143465 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:36.143437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:36.209966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:36.209893    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv" event={"ID":"815697d5-0ba2-49a2-8c70-6b33199749e6","Type":"ContainerDied","Data":"1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650"}
Sep 06 01:25:36.209966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:36.209943    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f92fb52bc05392ccebd111eb86dfafee436cc77d1ba754fd024d9669952b650"
Sep 06 01:25:36.209966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:36.209897    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"
Sep 06 01:25:38.019043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:38.019005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:25:40.366503 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:40.366473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:40.695092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:40.695066    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:40.982243 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:40.982140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:41.177580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:41.177551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.277372 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.277335    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.345374 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.345347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.403021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.402994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.450434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.450396    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"]
Sep 06 01:25:43.467292 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.467259    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f2686adc-cxvwv"]
Sep 06 01:25:43.467958 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.467933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.638077 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.638048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.702221 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.702170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:43.816396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:43.816363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:44.476587 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:44.476555    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="815697d5-0ba2-49a2-8c70-6b33199749e6" path="/var/lib/kubelet/pods/815697d5-0ba2-49a2-8c70-6b33199749e6/volumes"
Sep 06 01:25:44.773474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:44.773393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:45.035879 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.035794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:45.229381 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.229354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:45.334655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.334570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:45.342712 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.342688    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:25:45.343064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.343053    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="815697d5-0ba2-49a2-8c70-6b33199749e6" containerName="revoke-keys"
Sep 06 01:25:45.343118 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.343066    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="815697d5-0ba2-49a2-8c70-6b33199749e6" containerName="revoke-keys"
Sep 06 01:25:45.343158 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.343146    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="815697d5-0ba2-49a2-8c70-6b33199749e6" containerName="revoke-keys"
Sep 06 01:25:45.346689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.346671    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.350673 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.350652    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-41f259\""
Sep 06 01:25:45.350870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.350856    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-41f259-dockercfg-pbsvt\""
Sep 06 01:25:45.358019 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.357996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:25:45.378512 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.378484    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:25:45.382041 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.382019    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.393017 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.392996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:25:45.428543 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.428500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.428655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.428606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvh5n\" (UniqueName: \"kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.529241 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.529205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.529703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.529288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvh5n\" (UniqueName: \"kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.529703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.529311    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.529703 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.529329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqfp\" (UniqueName: \"kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.529853 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.529790    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.538622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.538593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvh5n\" (UniqueName: \"kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n\") pod \"payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.630526 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.630498    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.630684 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.630534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqfp\" (UniqueName: \"kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.631201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.631156    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.638070 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.638042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqfp\" (UniqueName: \"kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp\") pod \"payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.656935 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.656912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:45.693841 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.693807    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:45.927933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.927907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:25:45.930497 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:25:45.930473    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a13f83_f6a2_4e36_8d6b_c8cbf05c82e1.slice/crio-8c991d1afacb12c13807cfa83c217eba5fe43416773d8482d9344fbc0415225e WatchSource:0}: Error finding container 8c991d1afacb12c13807cfa83c217eba5fe43416773d8482d9344fbc0415225e: Status 404 returned error can't find the container with id 8c991d1afacb12c13807cfa83c217eba5fe43416773d8482d9344fbc0415225e
Sep 06 01:25:45.975694 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:45.975647    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:25:45.986373 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:25:45.986343    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151639f8_acff_4a88_a0f7_5cb4894ee09c.slice/crio-2829c163212ca5a83e1e1ba2d77499639ab14cdb924f21a619e7402aa8052d5d WatchSource:0}: Error finding container 2829c163212ca5a83e1e1ba2d77499639ab14cdb924f21a619e7402aa8052d5d: Status 404 returned error can't find the container with id 2829c163212ca5a83e1e1ba2d77499639ab14cdb924f21a619e7402aa8052d5d
Sep 06 01:25:46.263579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.263476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" event={"ID":"151639f8-acff-4a88-a0f7-5cb4894ee09c","Type":"ContainerStarted","Data":"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"}
Sep 06 01:25:46.263579 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.263535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" event={"ID":"151639f8-acff-4a88-a0f7-5cb4894ee09c","Type":"ContainerStarted","Data":"2829c163212ca5a83e1e1ba2d77499639ab14cdb924f21a619e7402aa8052d5d"}
Sep 06 01:25:46.263792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.263601    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:46.265203 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.265158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" event={"ID":"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1","Type":"ContainerStarted","Data":"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"}
Sep 06 01:25:46.265322 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.265219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" event={"ID":"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1","Type":"ContainerStarted","Data":"8c991d1afacb12c13807cfa83c217eba5fe43416773d8482d9344fbc0415225e"}
Sep 06 01:25:46.265322 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.265248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:25:46.282732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.282678    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" podStartSLOduration=1.282658593 podStartE2EDuration="1.282658593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:46.280313491 +0000 UTC m=+976.282795058" watchObservedRunningTime="2026-09-06 01:25:46.282658593 +0000 UTC m=+976.285140162"
Sep 06 01:25:46.298628 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:46.298588    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" podStartSLOduration=1.298575225 podStartE2EDuration="1.298575225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:46.297537237 +0000 UTC m=+976.300018811" watchObservedRunningTime="2026-09-06 01:25:46.298575225 +0000 UTC m=+976.301056782"
Sep 06 01:25:49.400995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:49.400964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:25:49.806031 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:49.805939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:49.906409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:49.906380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:50.073227 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:50.073126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:50.419590 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:50.419552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:50.518068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:50.518037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:50.636553 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:50.636509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:56.335219 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:56.335119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:56.435153 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:56.435115    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:56.534127 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:56.534093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:56.670406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:56.670377    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:25:57.272566 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:57.272537    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:25:57.272755 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:25:57.272690    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:26:02.239119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.239070    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:02.242839 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.242817    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.245359 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.245340    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-062abb\"/\"kube-root-ca.crt\""
Sep 06 01:26:02.245458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.245354    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-062abb\"/\"openshift-service-ca.crt\""
Sep 06 01:26:02.246445 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.246424    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-062abb\"/\"default-dockercfg-c8brl\""
Sep 06 01:26:02.246548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.246445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-062abb\"/\"noten-model-062abb-kserve-self-signed-certs\""
Sep 06 01:26:02.252451 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.252427    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:02.268696 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.268675    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:02.274937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.274916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.275026 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.274942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.275026 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.274970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.275117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.275025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dll6t\" (UniqueName: \"kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.275117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.275059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.275117 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.275080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375532 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dll6t\" (UniqueName: \"kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.375967 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.376030 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.375984    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.376099 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.376022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.378005 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.377986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.378194 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.378163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.383089 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.383068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dll6t\" (UniqueName: \"kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t\") pod \"noten-model-062abb-kserve-56bf7fcf5-c44mw\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") " pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.423298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.423271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:02.480033 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.480003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:02.554376 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.554310    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:02.825203 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:02.825158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:02.827246 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:26:02.827217    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8455a1a1_6e8a_4a44_8be1_93a68f3f036d.slice/crio-0cd2d6cca7ab6e60ee85bacec032026479efe1c1bd15147218fd3e53b0b307a2 WatchSource:0}: Error finding container 0cd2d6cca7ab6e60ee85bacec032026479efe1c1bd15147218fd3e53b0b307a2: Status 404 returned error can't find the container with id 0cd2d6cca7ab6e60ee85bacec032026479efe1c1bd15147218fd3e53b0b307a2
Sep 06 01:26:03.352092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.352055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" event={"ID":"8455a1a1-6e8a-4a44-8be1-93a68f3f036d","Type":"ContainerStarted","Data":"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"}
Sep 06 01:26:03.352485 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.352097    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" event={"ID":"8455a1a1-6e8a-4a44-8be1-93a68f3f036d","Type":"ContainerStarted","Data":"0cd2d6cca7ab6e60ee85bacec032026479efe1c1bd15147218fd3e53b0b307a2"}
Sep 06 01:26:03.370458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.370415    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" podStartSLOduration=1.370399226 podStartE2EDuration="1.370399226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:03.36783969 +0000 UTC m=+993.370321272" watchObservedRunningTime="2026-09-06 01:26:03.370399226 +0000 UTC m=+993.372880792"
Sep 06 01:26:03.387059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.387037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:03.703689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.703656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:03.939298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:03.939270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:04.927020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:04.926967    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:04.949765 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:04.949742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:05.050764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:05.050731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:05.270975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:05.270894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:05.395022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:05.394994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:06.922891 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:06.922863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:07.016384 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:07.016328    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:08.072620 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:08.072585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:08.298642 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:08.298612    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:08.610788 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:08.610760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:08.707300 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:08.707267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:08.788684 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:08.788647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:10.406924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:10.406880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:12.110601 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:12.110563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:26:12.555242 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:12.555206    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:13.040607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.040576    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:26:13.044278 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.044252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.047022 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.047001    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"openshift-service-ca.crt\""
Sep 06 01:26:13.047996 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.047972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"default-dockercfg-phksg\""
Sep 06 01:26:13.048138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.048018    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"kube-root-ca.crt\""
Sep 06 01:26:13.048138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.047979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"auth-test-model-5833d5-kserve-self-signed-certs\""
Sep 06 01:26:13.052619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.052210    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:26:13.065555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.065535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:13.077460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.077580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.077580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.077580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.077700 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.077700 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.077668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhklv\" (UniqueName: \"kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.178736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhklv\" (UniqueName: \"kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.178854    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.179106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.179215    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.179257 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.179240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.181303 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.181283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.181569 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.181549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.187133 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.187106    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhklv\" (UniqueName: \"kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv\") pod \"auth-test-model-5833d5-kserve-ff46b44c5-kds9x\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.355939 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.355858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:13.627317 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:13.627268    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:26:13.629620 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:26:13.629586    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd007c3a_d010_4423_96cb_22e3d3ec5bba.slice/crio-636a4d4a4518db649eddd13fd74a915ebab89a227ae70089a852cfa81730207e WatchSource:0}: Error finding container 636a4d4a4518db649eddd13fd74a915ebab89a227ae70089a852cfa81730207e: Status 404 returned error can't find the container with id 636a4d4a4518db649eddd13fd74a915ebab89a227ae70089a852cfa81730207e
Sep 06 01:26:14.408346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:14.408310    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" event={"ID":"dd007c3a-d010-4423-96cb-22e3d3ec5bba","Type":"ContainerStarted","Data":"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"}
Sep 06 01:26:14.408346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:14.408349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" event={"ID":"dd007c3a-d010-4423-96cb-22e3d3ec5bba","Type":"ContainerStarted","Data":"636a4d4a4518db649eddd13fd74a915ebab89a227ae70089a852cfa81730207e"}
Sep 06 01:26:14.426966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:14.426921    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" podStartSLOduration=1.426906056 podStartE2EDuration="1.426906056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:14.425765356 +0000 UTC m=+1004.428246919" watchObservedRunningTime="2026-09-06 01:26:14.426906056 +0000 UTC m=+1004.429387624"
Sep 06 01:26:20.381506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.381466    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" podUID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" containerName="main" containerID="cri-o://930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06" gracePeriod=45
Sep 06 01:26:20.624947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.624926    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:20.750950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.750867    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dll6t\" (UniqueName: \"kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.750950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.750919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.750950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.750937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.751252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.750989    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.751252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751024    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.751252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache\") pod \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\" (UID: \"8455a1a1-6e8a-4a44-8be1-93a68f3f036d\") "
Sep 06 01:26:20.751252 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751203    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home" (OuterVolumeSpecName: "home") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:20.751469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:20.751469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751414    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache" (OuterVolumeSpecName: "model-cache") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:20.751555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751472    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:20.751555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.751490    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:20.753454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.753431    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:26:20.753858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.753833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t" (OuterVolumeSpecName: "kube-api-access-dll6t") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "kube-api-access-dll6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:26:20.753858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.753838    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm" (OuterVolumeSpecName: "dshm") pod "8455a1a1-6e8a-4a44-8be1-93a68f3f036d" (UID: "8455a1a1-6e8a-4a44-8be1-93a68f3f036d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:20.852779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.852751    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dll6t\" (UniqueName: \"kubernetes.io/projected/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-kube-api-access-dll6t\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:20.852779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.852774    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:20.852779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.852784    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:20.852984 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:20.852793    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8455a1a1-6e8a-4a44-8be1-93a68f3f036d-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:26:21.452693 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.452653    2582 generic.go:356] "Generic (PLEG): container finished" podID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" containerID="930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06" exitCode=0
Sep 06 01:26:21.453146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.452708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" event={"ID":"8455a1a1-6e8a-4a44-8be1-93a68f3f036d","Type":"ContainerDied","Data":"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"}
Sep 06 01:26:21.453146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.452711    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"
Sep 06 01:26:21.453146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.452740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw" event={"ID":"8455a1a1-6e8a-4a44-8be1-93a68f3f036d","Type":"ContainerDied","Data":"0cd2d6cca7ab6e60ee85bacec032026479efe1c1bd15147218fd3e53b0b307a2"}
Sep 06 01:26:21.453146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.452758    2582 scope.go:117] "RemoveContainer" containerID="930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"
Sep 06 01:26:21.462238 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.462223    2582 scope.go:117] "RemoveContainer" containerID="930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"
Sep 06 01:26:21.462477 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:26:21.462460    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06\": container with ID starting with 930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06 not found: ID does not exist" containerID="930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"
Sep 06 01:26:21.462523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.462483    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06"} err="failed to get container status \"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06\": rpc error: code = NotFound desc = could not find container \"930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06\": container with ID starting with 930e937056ffba64c55fbe4a4454ccbf885e4ffd0687efd031980d8a6bfc1d06 not found: ID does not exist"
Sep 06 01:26:21.478200 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.474668    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:21.485428 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:21.485407    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-062abb/noten-model-062abb-kserve-56bf7fcf5-c44mw"]
Sep 06 01:26:22.477038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:22.477006    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" path="/var/lib/kubelet/pods/8455a1a1-6e8a-4a44-8be1-93a68f3f036d/volumes"
Sep 06 01:26:23.356735 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:23.356684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:23.356928 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:23.356750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:23.369208 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:23.369160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:23.474299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:23.474271    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:26:23.804019 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:23.803989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:26:25.961018 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:25.960983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:26.060662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:26.060630    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:31.870791 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:31.870753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:32.213774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:32.213692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:32.521739 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:32.521658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:33.088639 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:33.088600    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:35.970222 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:35.970166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:36.069820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:36.069784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:37.105961 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.105921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:37.217303 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.217272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:37.609940 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.609909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:37.692638 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.692607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:37.753162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.753134    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:26:37.753599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.753583    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" containerName="main"
Sep 06 01:26:37.753599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.753600    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" containerName="main"
Sep 06 01:26:37.753751 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.753682    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8455a1a1-6e8a-4a44-8be1-93a68f3f036d" containerName="main"
Sep 06 01:26:37.758321 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.758298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:37.760878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.760852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-bff89d-dockercfg-pcqcx\""
Sep 06 01:26:37.760878 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.760868    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-bff89d\""
Sep 06 01:26:37.768355 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.768332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:26:37.909202 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.909151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:37.909395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:37.909280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vchxr\" (UniqueName: \"kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.010599 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.010564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.010784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.010625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vchxr\" (UniqueName: \"kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.011388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.011369    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.018967 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.018943    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vchxr\" (UniqueName: \"kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr\") pod \"payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.069666 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.069631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.345609 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.345587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:26:38.348117 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:26:38.348091    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e58c6c_5ea5_4616_975a_498e2520ffa4.slice/crio-0117c558cb5ac5595cc2576b454f5d2d331dc7d78d15fa49ac52960b9d05f089 WatchSource:0}: Error finding container 0117c558cb5ac5595cc2576b454f5d2d331dc7d78d15fa49ac52960b9d05f089: Status 404 returned error can't find the container with id 0117c558cb5ac5595cc2576b454f5d2d331dc7d78d15fa49ac52960b9d05f089
Sep 06 01:26:38.537772 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.537732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" event={"ID":"30e58c6c-5ea5-4616-975a-498e2520ffa4","Type":"ContainerStarted","Data":"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"}
Sep 06 01:26:38.537924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.537885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:38.537981 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.537919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" event={"ID":"30e58c6c-5ea5-4616-975a-498e2520ffa4","Type":"ContainerStarted","Data":"0117c558cb5ac5595cc2576b454f5d2d331dc7d78d15fa49ac52960b9d05f089"}
Sep 06 01:26:38.556090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:38.556050    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" podStartSLOduration=1.556037068 podStartE2EDuration="1.556037068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:38.555029576 +0000 UTC m=+1028.557511141" watchObservedRunningTime="2026-09-06 01:26:38.556037068 +0000 UTC m=+1028.558518644"
Sep 06 01:26:43.904756 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.904724    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:26:43.928930 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.928900    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:26:43.932460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.932443    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.935334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.935312    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"kube-root-ca.crt\""
Sep 06 01:26:43.936299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.936276    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"default-dockercfg-8kzkj\""
Sep 06 01:26:43.936424 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.936386    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"openshift-service-ca.crt\""
Sep 06 01:26:43.936504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.936484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"auth-test-model-41f259-kserve-self-signed-certs\""
Sep 06 01:26:43.942145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.942125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:26:43.950395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.950375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:43.961047 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.961161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.961228 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.961278 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.961358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv6p4\" (UniqueName: \"kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:43.961394 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:43.961384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062330 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062150    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv6p4\" (UniqueName: \"kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062330 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062719 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.062817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.062795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.064567 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.064549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.064947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.064931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.077543 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.077517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv6p4\" (UniqueName: \"kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4\") pod \"auth-test-model-41f259-kserve-7c6b578dc5-5mcwm\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") " pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.242316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.242238    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:44.517543 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.517514    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:26:44.519978 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:26:44.519943    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e9b72fa_1fa6_4b34_8d73_b4a88571e453.slice/crio-f83955bfb536a2ac5b8a61a2f0c22f1ebf43d9d3382f1cf4f7cc6317245c4194 WatchSource:0}: Error finding container f83955bfb536a2ac5b8a61a2f0c22f1ebf43d9d3382f1cf4f7cc6317245c4194: Status 404 returned error can't find the container with id f83955bfb536a2ac5b8a61a2f0c22f1ebf43d9d3382f1cf4f7cc6317245c4194
Sep 06 01:26:44.569504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:44.569478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" event={"ID":"0e9b72fa-1fa6-4b34-8d73-b4a88571e453","Type":"ContainerStarted","Data":"f83955bfb536a2ac5b8a61a2f0c22f1ebf43d9d3382f1cf4f7cc6317245c4194"}
Sep 06 01:26:45.576290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:45.576245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" event={"ID":"0e9b72fa-1fa6-4b34-8d73-b4a88571e453","Type":"ContainerStarted","Data":"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"}
Sep 06 01:26:45.593886 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:45.593829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" podStartSLOduration=2.593812904 podStartE2EDuration="2.593812904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:45.592978404 +0000 UTC m=+1035.595459970" watchObservedRunningTime="2026-09-06 01:26:45.593812904 +0000 UTC m=+1035.596294469"
Sep 06 01:26:47.414843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:47.414801    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:26:49.545858 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:49.545827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:26:54.243400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:54.243358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:54.243868 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:54.243433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:54.255869 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:54.255845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:54.632254 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:54.632227    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:26:59.109366 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:26:59.109332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:27:01.036503 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:01.036462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:13.604471 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:13.604438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:27:14.081199 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:14.081146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:14.369623 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:14.369597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:14.469604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:14.469571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:17.324476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:17.324446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:17.422931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:17.422894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:18.634884 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:18.634845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:18.737192 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:18.737147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:19.063028 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:19.062950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:19.168439 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:19.168408    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:28.697927 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:28.697845    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:27:30.584436 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:30.584405    2582 scope.go:117] "RemoveContainer" containerID="ce4d1d5238709da9e142d422c2d632bf474a38fd5c648e46616b9e67f049f02b"
Sep 06 01:27:42.401734 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:42.401703    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:47.503058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:47.503022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:27:53.341086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.341052    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:27:53.346591 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.346569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.349157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.349132    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2c9b203a\"/\"openshift-service-ca.crt\""
Sep 06 01:27:53.349157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.349152    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2c9b203a\"/\"default-dockercfg-c6khn\""
Sep 06 01:27:53.350064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.350043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2c9b203a\"/\"kube-root-ca.crt\""
Sep 06 01:27:53.350162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.350042    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2c9b203a\"/\"e2e-lifecycle-model-2c9b203a-kserve-self-signed-certs\""
Sep 06 01:27:53.354995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.354970    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:27:53.373192 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.373163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:27:53.497270 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497240    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.497429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.497429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497314    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.497429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.497429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.497569 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.497430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm7jv\" (UniqueName: \"kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm7jv\" (UniqueName: \"kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598626 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598808 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598870 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598805    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.598986 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.599052 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.598990    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.599115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.599100    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.601038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.601017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.601455 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.601436    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.606316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.606294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm7jv\" (UniqueName: \"kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv\") pod \"e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") " pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.658218 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.658173    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:27:53.931146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:53.931122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:27:53.932846 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:27:53.932821    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod347c5cf5_935d_449a_9b59_fa95582b3613.slice/crio-f4f4a9a02b219bbf40f2bd3cc6400fe897c453cba5bed19a7c192f20026cab5d WatchSource:0}: Error finding container f4f4a9a02b219bbf40f2bd3cc6400fe897c453cba5bed19a7c192f20026cab5d: Status 404 returned error can't find the container with id f4f4a9a02b219bbf40f2bd3cc6400fe897c453cba5bed19a7c192f20026cab5d
Sep 06 01:27:54.925224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:54.925166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" event={"ID":"347c5cf5-935d-449a-9b59-fa95582b3613","Type":"ContainerStarted","Data":"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"}
Sep 06 01:27:54.925610 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:54.925234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" event={"ID":"347c5cf5-935d-449a-9b59-fa95582b3613","Type":"ContainerStarted","Data":"f4f4a9a02b219bbf40f2bd3cc6400fe897c453cba5bed19a7c192f20026cab5d"}
Sep 06 01:27:54.943488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:27:54.943442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" podStartSLOduration=1.943426935 podStartE2EDuration="1.943426935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:27:54.942383693 +0000 UTC m=+1104.944865273" watchObservedRunningTime="2026-09-06 01:27:54.943426935 +0000 UTC m=+1104.945908501"
Sep 06 01:28:03.160789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:03.160753    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:28:03.658753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:03.658725    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:28:03.658908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:03.658772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:28:03.671452 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:03.671426    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:28:03.981820 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:03.981736    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:28:20.401458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:20.401423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:28:35.798502 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:35.798465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:28:42.404992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:42.404960    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:28:42.415216 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:42.415154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:43.218594 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.218544    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:43.330906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.330872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:43.437449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.437416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:43.496482 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.496405    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:43.823477 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.823395    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:28:43.837654 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:43.837626    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:46.782906 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:46.782869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:48.504223 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:48.504172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:28:50.431313 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:50.431282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:51.766885 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:51.766808    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:28:51.862759 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:51.862730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:28:57.425574 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.425510    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" podUID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" containerName="main" containerID="cri-o://7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b" gracePeriod=45
Sep 06 01:28:57.667760 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.667737    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:28:57.702697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702633    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhklv\" (UniqueName: \"kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702851    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm\") pod \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\" (UID: \"dd007c3a-d010-4423-96cb-22e3d3ec5bba\") "
Sep 06 01:28:57.702955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home" (OuterVolumeSpecName: "home") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:57.702955 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.702913    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:57.703231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.703049    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:57.703420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.703367    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:57.703420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.703386    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:57.703420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.703395    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:57.705067 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.705043    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv" (OuterVolumeSpecName: "kube-api-access-rhklv") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "kube-api-access-rhklv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:57.705067 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.705056    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:28:57.705350 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.705335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm" (OuterVolumeSpecName: "dshm") pod "dd007c3a-d010-4423-96cb-22e3d3ec5bba" (UID: "dd007c3a-d010-4423-96cb-22e3d3ec5bba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:57.804687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.804663    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd007c3a-d010-4423-96cb-22e3d3ec5bba-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:57.804687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.804685    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd007c3a-d010-4423-96cb-22e3d3ec5bba-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:57.804866 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:57.804698    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhklv\" (UniqueName: \"kubernetes.io/projected/dd007c3a-d010-4423-96cb-22e3d3ec5bba-kube-api-access-rhklv\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:58.250656 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.250619    2582 generic.go:356] "Generic (PLEG): container finished" podID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" containerID="7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b" exitCode=0
Sep 06 01:28:58.250828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.250665    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"
Sep 06 01:28:58.250828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.250678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" event={"ID":"dd007c3a-d010-4423-96cb-22e3d3ec5bba","Type":"ContainerDied","Data":"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"}
Sep 06 01:28:58.250828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.250716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x" event={"ID":"dd007c3a-d010-4423-96cb-22e3d3ec5bba","Type":"ContainerDied","Data":"636a4d4a4518db649eddd13fd74a915ebab89a227ae70089a852cfa81730207e"}
Sep 06 01:28:58.250828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.250737    2582 scope.go:117] "RemoveContainer" containerID="7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"
Sep 06 01:28:58.259965 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.259949    2582 scope.go:117] "RemoveContainer" containerID="7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"
Sep 06 01:28:58.260233 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:28:58.260216    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b\": container with ID starting with 7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b not found: ID does not exist" containerID="7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"
Sep 06 01:28:58.260293 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.260243    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b"} err="failed to get container status \"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b\": rpc error: code = NotFound desc = could not find container \"7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b\": container with ID starting with 7b7ce80cc3fa6c5b20130fc200cb9ca9af420de6b3e59e8a240912af161e867b not found: ID does not exist"
Sep 06 01:28:58.273271 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.273245    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:28:58.278799 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.278780    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/auth-test-model-5833d5-kserve-ff46b44c5-kds9x"]
Sep 06 01:28:58.477519 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.477482    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" path="/var/lib/kubelet/pods/dd007c3a-d010-4423-96cb-22e3d3ec5bba/volumes"
Sep 06 01:28:58.844104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:58.844069    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" podUID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" containerName="main" containerID="cri-o://7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d" gracePeriod=45
Sep 06 01:28:59.113146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.113119    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:28:59.217428 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217396    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217448    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217496    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217600 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217559    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv6p4\" (UniqueName: \"kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217819 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217605    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache\") pod \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\" (UID: \"0e9b72fa-1fa6-4b34-8d73-b4a88571e453\") "
Sep 06 01:28:59.217874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217811    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home" (OuterVolumeSpecName: "home") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:59.217874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217824    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:59.217945 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.217892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:59.219814 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.219783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm" (OuterVolumeSpecName: "dshm") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:28:59.219937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.219886    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:28:59.219937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.219890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4" (OuterVolumeSpecName: "kube-api-access-zv6p4") pod "0e9b72fa-1fa6-4b34-8d73-b4a88571e453" (UID: "0e9b72fa-1fa6-4b34-8d73-b4a88571e453"). InnerVolumeSpecName "kube-api-access-zv6p4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:59.257515 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.257487    2582 generic.go:356] "Generic (PLEG): container finished" podID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" containerID="7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d" exitCode=0
Sep 06 01:28:59.257641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.257529    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" event={"ID":"0e9b72fa-1fa6-4b34-8d73-b4a88571e453","Type":"ContainerDied","Data":"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"}
Sep 06 01:28:59.257641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.257535    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"
Sep 06 01:28:59.257641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.257553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm" event={"ID":"0e9b72fa-1fa6-4b34-8d73-b4a88571e453","Type":"ContainerDied","Data":"f83955bfb536a2ac5b8a61a2f0c22f1ebf43d9d3382f1cf4f7cc6317245c4194"}
Sep 06 01:28:59.257641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.257570    2582 scope.go:117] "RemoveContainer" containerID="7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"
Sep 06 01:28:59.266894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.266879    2582 scope.go:117] "RemoveContainer" containerID="7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"
Sep 06 01:28:59.267166 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:28:59.267150    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d\": container with ID starting with 7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d not found: ID does not exist" containerID="7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"
Sep 06 01:28:59.267234 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.267173    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d"} err="failed to get container status \"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d\": rpc error: code = NotFound desc = could not find container \"7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d\": container with ID starting with 7ea02601c7fc20c275e20008f9cb6b6aae27c2e48b9164128421f23af546a76d not found: ID does not exist"
Sep 06 01:28:59.278769 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.278742    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:28:59.283984 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.283959    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/auth-test-model-41f259-kserve-7c6b578dc5-5mcwm"]
Sep 06 01:28:59.318783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318759    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:59.318783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318778    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:59.318783 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318786    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:59.318938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318793    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:59.318938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318803    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv6p4\" (UniqueName: \"kubernetes.io/projected/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-kube-api-access-zv6p4\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:28:59.318938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:28:59.318812    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e9b72fa-1fa6-4b34-8d73-b4a88571e453-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:00.477807 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:00.477735    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" path="/var/lib/kubelet/pods/0e9b72fa-1fa6-4b34-8d73-b4a88571e453/volumes"
Sep 06 01:29:01.901937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:01.901905    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:29:06.787542 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:06.787502    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" podUID="347c5cf5-935d-449a-9b59-fa95582b3613" containerName="main" containerID="cri-o://e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616" gracePeriod=45
Sep 06 01:29:07.038786 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.038730    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:29:07.090023 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.089996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm7jv\" (UniqueName: \"kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache\") pod \"347c5cf5-935d-449a-9b59-fa95582b3613\" (UID: \"347c5cf5-935d-449a-9b59-fa95582b3613\") "
Sep 06 01:29:07.090518 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090420    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home" (OuterVolumeSpecName: "home") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:07.090602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090584    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.090680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090654    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache" (OuterVolumeSpecName: "model-cache") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:07.090736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.090685    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:07.092715 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.092689    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv" (OuterVolumeSpecName: "kube-api-access-cm7jv") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "kube-api-access-cm7jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:29:07.092855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.092782    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:29:07.092855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.092798    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm" (OuterVolumeSpecName: "dshm") pod "347c5cf5-935d-449a-9b59-fa95582b3613" (UID: "347c5cf5-935d-449a-9b59-fa95582b3613"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:07.191790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.191755    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.191790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.191782    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.191790 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.191796    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm7jv\" (UniqueName: \"kubernetes.io/projected/347c5cf5-935d-449a-9b59-fa95582b3613-kube-api-access-cm7jv\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.192025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.191808    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347c5cf5-935d-449a-9b59-fa95582b3613-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.192025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.191820    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347c5cf5-935d-449a-9b59-fa95582b3613-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:29:07.298209 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.298102    2582 generic.go:356] "Generic (PLEG): container finished" podID="347c5cf5-935d-449a-9b59-fa95582b3613" containerID="e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616" exitCode=0
Sep 06 01:29:07.298209 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.298148    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"
Sep 06 01:29:07.298209 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.298160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" event={"ID":"347c5cf5-935d-449a-9b59-fa95582b3613","Type":"ContainerDied","Data":"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"}
Sep 06 01:29:07.298481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.298221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn" event={"ID":"347c5cf5-935d-449a-9b59-fa95582b3613","Type":"ContainerDied","Data":"f4f4a9a02b219bbf40f2bd3cc6400fe897c453cba5bed19a7c192f20026cab5d"}
Sep 06 01:29:07.298481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.298246    2582 scope.go:117] "RemoveContainer" containerID="e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"
Sep 06 01:29:07.307111 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.307098    2582 scope.go:117] "RemoveContainer" containerID="e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"
Sep 06 01:29:07.307372 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:29:07.307353    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616\": container with ID starting with e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616 not found: ID does not exist" containerID="e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"
Sep 06 01:29:07.307448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.307378    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616"} err="failed to get container status \"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616\": rpc error: code = NotFound desc = could not find container \"e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616\": container with ID starting with e740d031fa2f35bc0cb8e60ff9605fc502b8ffe5e92b703f52eaa942f5705616 not found: ID does not exist"
Sep 06 01:29:07.319365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.319342    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:29:07.322908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:07.322882    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2c9b203a/e2e-lifecycle-model-2c9b203a-kserve-7674b99db7-2w9jn"]
Sep 06 01:29:08.477779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:08.477746    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="347c5cf5-935d-449a-9b59-fa95582b3613" path="/var/lib/kubelet/pods/347c5cf5-935d-449a-9b59-fa95582b3613/volumes"
Sep 06 01:29:21.242628 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.242592    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.242997    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243009    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243019    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347c5cf5-935d-449a-9b59-fa95582b3613" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243024    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="347c5cf5-935d-449a-9b59-fa95582b3613" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243048    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243054    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243110    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="347c5cf5-935d-449a-9b59-fa95582b3613" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243122    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e9b72fa-1fa6-4b34-8d73-b4a88571e453" containerName="main"
Sep 06 01:29:21.243138 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.243130    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd007c3a-d010-4423-96cb-22e3d3ec5bba" containerName="main"
Sep 06 01:29:21.247717 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.247696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.251531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.251325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"openshift-service-ca.crt\""
Sep 06 01:29:21.251531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.251382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"sub-test-model-41f259-kserve-self-signed-certs\""
Sep 06 01:29:21.251531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.251327    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"default-dockercfg-8kzkj\""
Sep 06 01:29:21.251743 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.251641    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-41f259\"/\"kube-root-ca.crt\""
Sep 06 01:29:21.259725 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.259699    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:29:21.273594 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.273565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:21.420789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.420760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.420988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.420809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.420988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.420875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.420988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.420918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.420988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.420947    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2s5l\" (UniqueName: \"kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.421163 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.421035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521645    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.521821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521708    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2s5l\" (UniqueName: \"kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.522025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.522025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.521954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.522025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.522011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.524065 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.524042    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.524265 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.524248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.530495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.530476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2s5l\" (UniqueName: \"kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l\") pod \"sub-test-model-41f259-kserve-57fbcdcc-7qk5z\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") " pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.559848 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.559826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:21.835356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:21.835333    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:29:21.837225 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:29:21.837197    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ff2216f_e868_4bb9_b2c5_792b7f7c6ea0.slice/crio-3bda2f9e4c002e3f654b5f599105d6c12fa65f197cc76881664b82444f2ac114 WatchSource:0}: Error finding container 3bda2f9e4c002e3f654b5f599105d6c12fa65f197cc76881664b82444f2ac114: Status 404 returned error can't find the container with id 3bda2f9e4c002e3f654b5f599105d6c12fa65f197cc76881664b82444f2ac114
Sep 06 01:29:22.377529 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:22.377494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" event={"ID":"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0","Type":"ContainerStarted","Data":"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"}
Sep 06 01:29:22.377984 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:22.377538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" event={"ID":"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0","Type":"ContainerStarted","Data":"3bda2f9e4c002e3f654b5f599105d6c12fa65f197cc76881664b82444f2ac114"}
Sep 06 01:29:22.396232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:22.396167    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" podStartSLOduration=1.396149183 podStartE2EDuration="1.396149183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:29:22.394146802 +0000 UTC m=+1192.396628370" watchObservedRunningTime="2026-09-06 01:29:22.396149183 +0000 UTC m=+1192.398630757"
Sep 06 01:29:25.601687 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:25.601650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:29:27.031113 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:27.031082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:27.083258 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:27.083231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:28.473564 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:28.473535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:28.872770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:28.872745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:30.498067 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:30.498041    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:29:30.501496 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:30.501478    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:29:31.560674 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:31.560646    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:31.561077 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:31.560685    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:31.573196 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:31.573151    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:32.445774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:32.445743    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:29:34.409514 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:34.409488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:34.479723 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:34.479689    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:34.688316 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:34.688232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:36.032354 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:36.032317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:36.132064 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:36.132029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:36.262816 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:36.262790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:36.886729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:36.886687    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:36.986306 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:36.986280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:37.086821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:37.086796    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:38.576997 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:38.576965    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:40.598410 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:40.598379    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:29:44.251165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:44.251135    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:44.309510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:44.309452    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:44.971709 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:44.971681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:50.761822 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:50.761786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:50.843716 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:50.843686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:50.934608 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:50.934573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:51.035268 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:51.035152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:29:58.898145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:29:58.898103    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:30:00.140576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.140540    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"]
Sep 06 01:30:00.144056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.144037    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"]
Sep 06 01:30:00.144166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.144146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"
Sep 06 01:30:00.146539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.146522    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:30:00.147086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.147069    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"]
Sep 06 01:30:00.147241 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.147224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"
Sep 06 01:30:00.150494 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.150477    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"
Sep 06 01:30:00.154098 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.153555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"]
Sep 06 01:30:00.156651 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.156623    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"]
Sep 06 01:30:00.159157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.159039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"
Sep 06 01:30:00.159157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.159105    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"]
Sep 06 01:30:00.168886 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.168869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"
Sep 06 01:30:00.204230 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.204167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"
Sep 06 01:30:00.436824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.436801    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"]
Sep 06 01:30:00.438930 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:30:00.438898    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93704d62_913e_42b7_a3fd_03302150a100.slice/crio-8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6 WatchSource:0}: Error finding container 8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6: Status 404 returned error can't find the container with id 8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6
Sep 06 01:30:00.457746 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.457722    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"]
Sep 06 01:30:00.459598 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:30:00.459578    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22ce8f1_ccc4_4b6e_841a_e8fc75cec2f3.slice/crio-d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330 WatchSource:0}: Error finding container d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330: Status 404 returned error can't find the container with id d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330
Sep 06 01:30:00.496368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.496347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"]
Sep 06 01:30:00.497977 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:30:00.497957    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46e00fa_9cc0_469c_bef0_a5347b1acc51.slice/crio-0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07 WatchSource:0}: Error finding container 0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07: Status 404 returned error can't find the container with id 0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07
Sep 06 01:30:00.575497 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.575463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx" event={"ID":"93704d62-913e-42b7-a3fd-03302150a100","Type":"ContainerStarted","Data":"8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6"}
Sep 06 01:30:00.576768 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.576740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n" event={"ID":"f46e00fa-9cc0-469c-bef0-a5347b1acc51","Type":"ContainerStarted","Data":"0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07"}
Sep 06 01:30:00.577832 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:00.577809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl" event={"ID":"c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3","Type":"ContainerStarted","Data":"d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330"}
Sep 06 01:30:01.585002 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.584962    2582 generic.go:356] "Generic (PLEG): container finished" podID="93704d62-913e-42b7-a3fd-03302150a100" containerID="286b8db6644dc7fd174d168fc43a45010ab83e7ec22a1f192eb5788e24e4ab77" exitCode=0
Sep 06 01:30:01.585420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.585038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx" event={"ID":"93704d62-913e-42b7-a3fd-03302150a100","Type":"ContainerDied","Data":"286b8db6644dc7fd174d168fc43a45010ab83e7ec22a1f192eb5788e24e4ab77"}
Sep 06 01:30:01.586576 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.586556    2582 generic.go:356] "Generic (PLEG): container finished" podID="f46e00fa-9cc0-469c-bef0-a5347b1acc51" containerID="c7c3d4f1dfb94100e6bed92eef5db309c4b5f170028d25505defd719ee714d3f" exitCode=0
Sep 06 01:30:01.586716 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.586640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n" event={"ID":"f46e00fa-9cc0-469c-bef0-a5347b1acc51","Type":"ContainerDied","Data":"c7c3d4f1dfb94100e6bed92eef5db309c4b5f170028d25505defd719ee714d3f"}
Sep 06 01:30:01.588389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.588368    2582 generic.go:356] "Generic (PLEG): container finished" podID="c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3" containerID="6eeb024c48b4b71d35e191fba894e46bb309e4be0d7b12c1c8b6c211a38f391e" exitCode=0
Sep 06 01:30:01.588476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.588410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl" event={"ID":"c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3","Type":"ContainerDied","Data":"6eeb024c48b4b71d35e191fba894e46bb309e4be0d7b12c1c8b6c211a38f391e"}
Sep 06 01:30:01.736372 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.736292    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:01.858475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:01.858436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:02.728195 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:02.727332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:30:02.752449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:02.752396    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:02.754146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:02.754125    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"
Sep 06 01:30:02.788270 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:02.788249    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"
Sep 06 01:30:02.794365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:02.794348    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"
Sep 06 01:30:03.603141 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.603109    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"
Sep 06 01:30:03.603141 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.603130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx" event={"ID":"93704d62-913e-42b7-a3fd-03302150a100","Type":"ContainerDied","Data":"8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6"}
Sep 06 01:30:03.603397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.603205    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c33c3d00cb8dc05db5a2cb28745ab45d4afba34e92ef04488bd9238d1c9e5a6"
Sep 06 01:30:03.604489 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.604469    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"
Sep 06 01:30:03.604621 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.604517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n" event={"ID":"f46e00fa-9cc0-469c-bef0-a5347b1acc51","Type":"ContainerDied","Data":"0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07"}
Sep 06 01:30:03.604621 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.604574    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0645d067389e7ff1eaf019da4b923a59bcfad3c4e585b43c96c516dab7554b07"
Sep 06 01:30:03.605957 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.605934    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl" event={"ID":"c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3","Type":"ContainerDied","Data":"d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330"}
Sep 06 01:30:03.605957 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.605956    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29810970-b86vl"
Sep 06 01:30:03.606086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:03.605973    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5b1e9a5bdb4ecb3ac082cec3c6bcd63715d2aef84d0ec74269e4677d34e3330"
Sep 06 01:30:11.499739 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:11.499705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:30:12.847641 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.847608    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:30:12.848171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848153    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93704d62-913e-42b7-a3fd-03302150a100" containerName="cleanup"
Sep 06 01:30:12.848290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848194    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="93704d62-913e-42b7-a3fd-03302150a100" containerName="cleanup"
Sep 06 01:30:12.848290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848236    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46e00fa-9cc0-469c-bef0-a5347b1acc51" containerName="cleanup"
Sep 06 01:30:12.848290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848246    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46e00fa-9cc0-469c-bef0-a5347b1acc51" containerName="cleanup"
Sep 06 01:30:12.848290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848258    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3" containerName="cleanup"
Sep 06 01:30:12.848290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848266    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3" containerName="cleanup"
Sep 06 01:30:12.848560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848378    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3" containerName="cleanup"
Sep 06 01:30:12.848560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848393    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="93704d62-913e-42b7-a3fd-03302150a100" containerName="cleanup"
Sep 06 01:30:12.848560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.848403    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f46e00fa-9cc0-469c-bef0-a5347b1acc51" containerName="cleanup"
Sep 06 01:30:12.851631 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.851610    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.855255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.855234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"kube-root-ca.crt\""
Sep 06 01:30:12.855255 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.855246    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"rate-test-model-5833d5-kserve-self-signed-certs\""
Sep 06 01:30:12.855446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.855304    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"openshift-service-ca.crt\""
Sep 06 01:30:12.855446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.855352    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5833d5\"/\"default-dockercfg-phksg\""
Sep 06 01:30:12.861447 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.861427    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:30:12.869170 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.869148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:12.899367 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.899474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.899474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.899474 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.899604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899522    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:12.899604 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:12.899589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9z5z\" (UniqueName: \"kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000239 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9z5z\" (UniqueName: \"kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000565 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000619 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000725 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000701    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000817 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.000869 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.000846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.002742 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.002723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.003026 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.003011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.008894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.008872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9z5z\" (UniqueName: \"kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z\") pod \"rate-test-model-5833d5-kserve-6d45c554d7-xd8sk\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") " pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.162308 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.162278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:13.449403 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.449373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:30:13.658551 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.658513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" event={"ID":"097efd1e-2ea3-4cea-b159-404163a51056","Type":"ContainerStarted","Data":"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"}
Sep 06 01:30:13.658551 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.658557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" event={"ID":"097efd1e-2ea3-4cea-b159-404163a51056","Type":"ContainerStarted","Data":"52de78b8ad2b3814c99eee6552ea7c67be14fa1ece427beca0b0350267ba91ca"}
Sep 06 01:30:13.677020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:13.676971    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" podStartSLOduration=1.6769569949999998 podStartE2EDuration="1.676956995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:13.675263562 +0000 UTC m=+1243.677745131" watchObservedRunningTime="2026-09-06 01:30:13.676956995 +0000 UTC m=+1243.679438560"
Sep 06 01:30:17.756331 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:17.756281    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" podUID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" containerName="main" containerID="cri-o://a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521" gracePeriod=45
Sep 06 01:30:18.005874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.005847    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:30:18.037571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037498    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.037764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2s5l\" (UniqueName: \"kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.037764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037619    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.037764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.037764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.037764 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037682    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm\") pod \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\" (UID: \"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0\") "
Sep 06 01:30:18.038026 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.037891    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache" (OuterVolumeSpecName: "model-cache") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:18.038080 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.038047    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.038124 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.038079    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:18.038306 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.038130    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home" (OuterVolumeSpecName: "home") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:18.039686 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.039665    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:30:18.040054 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.040016    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm" (OuterVolumeSpecName: "dshm") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:30:18.040161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.040132    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l" (OuterVolumeSpecName: "kube-api-access-h2s5l") pod "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" (UID: "2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0"). InnerVolumeSpecName "kube-api-access-h2s5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:30:18.139290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.139257    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2s5l\" (UniqueName: \"kubernetes.io/projected/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-kube-api-access-h2s5l\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.139290 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.139286    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.139465 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.139301    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.139465 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.139312    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.139465 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.139322    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:30:18.689888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.689848    2582 generic.go:356] "Generic (PLEG): container finished" podID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" containerID="a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521" exitCode=0
Sep 06 01:30:18.689888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.689888    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"
Sep 06 01:30:18.690104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.689928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" event={"ID":"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0","Type":"ContainerDied","Data":"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"}
Sep 06 01:30:18.690104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.689967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z" event={"ID":"2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0","Type":"ContainerDied","Data":"3bda2f9e4c002e3f654b5f599105d6c12fa65f197cc76881664b82444f2ac114"}
Sep 06 01:30:18.690104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.689982    2582 scope.go:117] "RemoveContainer" containerID="a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"
Sep 06 01:30:18.698936 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.698918    2582 scope.go:117] "RemoveContainer" containerID="a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"
Sep 06 01:30:18.699221 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:30:18.699203    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521\": container with ID starting with a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521 not found: ID does not exist" containerID="a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"
Sep 06 01:30:18.699279 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.699231    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521"} err="failed to get container status \"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521\": rpc error: code = NotFound desc = could not find container \"a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521\": container with ID starting with a09e8b2663a43f82002e37dd091ef940878eef2b9e05a04ee1303dcd0fbaf521 not found: ID does not exist"
Sep 06 01:30:18.707191 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.707152    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:30:18.711285 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:18.711264    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-41f259/sub-test-model-41f259-kserve-57fbcdcc-7qk5z"]
Sep 06 01:30:20.476877 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:20.476841    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" path="/var/lib/kubelet/pods/2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0/volumes"
Sep 06 01:30:22.697879 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:22.697802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:30:22.782695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:22.782662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:23.163025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:23.162998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:23.163213 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:23.163048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:23.175125 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:23.175102    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:23.727975 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:23.727944    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:30:27.882362 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:27.882332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:28.892163 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:28.892127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:28.995398 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:28.995364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:29.279393 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:29.279306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:29.622079 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:29.622053    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:29.872299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:29.872203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:32.467649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:32.467614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:32.556293 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:32.556259    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:33.505224 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:33.505192    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:30:33.751388 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:33.751362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:34.022000 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.021950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:34.315368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.315284    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:34.410381 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.410348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:34.489675 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.489647    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:30:34.490021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.490009    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" containerName="main"
Sep 06 01:30:34.490021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.490022    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" containerName="main"
Sep 06 01:30:34.490115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.490098    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff2216f-e868-4bb9-b2c5-792b7f7c6ea0" containerName="main"
Sep 06 01:30:34.494603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.494584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.497391 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.497362    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a7b006\""
Sep 06 01:30:34.497822 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.497673    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a7b006-dockercfg-7whvn\""
Sep 06 01:30:34.503368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.503347    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:30:34.582147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.582076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbhs8\" (UniqueName: \"kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.582147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.582110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.683464 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.683425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbhs8\" (UniqueName: \"kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.683638 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.683472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.684386 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.684363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.691859 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.691828    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbhs8\" (UniqueName: \"kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8\") pod \"payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:34.805987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:34.805950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:35.082938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:35.082910    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:30:35.085135 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:30:35.085107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0181fb51_a294_4f63_90a3_0c62b4a223a3.slice/crio-4704ea383846a41b73189e29b5075ac4fcb7071daffe74f9e44607dcae0f60a0 WatchSource:0}: Error finding container 4704ea383846a41b73189e29b5075ac4fcb7071daffe74f9e44607dcae0f60a0: Status 404 returned error can't find the container with id 4704ea383846a41b73189e29b5075ac4fcb7071daffe74f9e44607dcae0f60a0
Sep 06 01:30:35.778245 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:35.778211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" event={"ID":"0181fb51-a294-4f63-90a3-0c62b4a223a3","Type":"ContainerStarted","Data":"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"}
Sep 06 01:30:35.778639 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:35.778260    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" event={"ID":"0181fb51-a294-4f63-90a3-0c62b4a223a3","Type":"ContainerStarted","Data":"4704ea383846a41b73189e29b5075ac4fcb7071daffe74f9e44607dcae0f60a0"}
Sep 06 01:30:35.778639 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:35.778327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:46.786944 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:46.786912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:30:46.805542 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:46.805495    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" podStartSLOduration=12.805480512 podStartE2EDuration="12.805480512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:35.795660571 +0000 UTC m=+1265.798142139" watchObservedRunningTime="2026-09-06 01:30:46.805480512 +0000 UTC m=+1276.807962078"
Sep 06 01:30:52.198375 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:52.198343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:30:57.494877 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:57.494846    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:58.003883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:58.003848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:58.323635 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:58.323557    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:30:58.452144 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:30:58.452108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:01.584677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:01.584648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:01.693728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:01.693700    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:02.847456 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:02.847426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:03.312822 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.312786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:03.398397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.398370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:03.399223 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.399203    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:31:03.402702 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.402686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.405214 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.405173    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-20a262\""
Sep 06 01:31:03.413710 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.413689    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:31:03.453395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.453354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.453583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.453518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg6ks\" (UniqueName: \"kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.554065 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.554023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg6ks\" (UniqueName: \"kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.554265 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.554100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.554823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.554800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.564655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.564593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg6ks\" (UniqueName: \"kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks\") pod \"payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.714340 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.714303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:03.985219 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:03.985169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:31:03.987452 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:03.987409    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c6ad82_6de9_457d_a693_8b1a8bcb5c95.slice/crio-30f5785e7922dc76394c0244e3d1c546f071e3d5423739272ccd54c94389c3c3 WatchSource:0}: Error finding container 30f5785e7922dc76394c0244e3d1c546f071e3d5423739272ccd54c94389c3c3: Status 404 returned error can't find the container with id 30f5785e7922dc76394c0244e3d1c546f071e3d5423739272ccd54c94389c3c3
Sep 06 01:31:04.937380 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:04.937349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" event={"ID":"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95","Type":"ContainerStarted","Data":"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"}
Sep 06 01:31:04.937552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:04.937397    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" event={"ID":"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95","Type":"ContainerStarted","Data":"30f5785e7922dc76394c0244e3d1c546f071e3d5423739272ccd54c94389c3c3"}
Sep 06 01:31:04.937552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:04.937435    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:04.957446 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:04.957397    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" podStartSLOduration=1.957383064 podStartE2EDuration="1.957383064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:04.955822138 +0000 UTC m=+1294.958303704" watchObservedRunningTime="2026-09-06 01:31:04.957383064 +0000 UTC m=+1294.959864630"
Sep 06 01:31:13.299843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:13.299807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:31:15.945343 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:15.945311    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:31:17.050146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:17.050115    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:31:17.073205 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:17.073156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:18.088980 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:18.088953    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:18.566681 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:18.566654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:18.878502 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:18.878475    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:18.974368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:18.974339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:22.366024 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:22.365992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:22.469123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:22.469096    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:23.628125 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:23.628099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:24.055352 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.055248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:24.151273 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.151241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:24.158874 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.158847    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:31:24.163622 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.163603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.169591 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.169573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-de7322\""
Sep 06 01:31:24.169857 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.169837    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-de7322-dockercfg-c4fwg\""
Sep 06 01:31:24.174752 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.174732    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:31:24.195485 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.195459    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:31:24.199693 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.199675    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.206570 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.206552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:31:24.245298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.245272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.245460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.245332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269r2\" (UniqueName: \"kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.245460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.245399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.245460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.245433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5bz9\" (UniqueName: \"kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.346986 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.346905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.347145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.346983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-269r2\" (UniqueName: \"kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.347145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.347015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.347145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.347042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5bz9\" (UniqueName: \"kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.347707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.347683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.347794 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.347732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.361690 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.361665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-269r2\" (UniqueName: \"kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2\") pod \"payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.361807 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.361760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:24.362603 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.362581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5bz9\" (UniqueName: \"kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9\") pod \"payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.474716 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.474684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:24.511439 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.511403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:24.754349 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.754325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:31:24.756056 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:24.756031    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64e2752_1dec_4d2a_a71c_0a4a13cd7b45.slice/crio-bb7f871d7beb6959007b9520bf508c7ab7bdea7ce521b53765136a8566a563da WatchSource:0}: Error finding container bb7f871d7beb6959007b9520bf508c7ab7bdea7ce521b53765136a8566a563da: Status 404 returned error can't find the container with id bb7f871d7beb6959007b9520bf508c7ab7bdea7ce521b53765136a8566a563da
Sep 06 01:31:24.795987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:24.795894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:31:24.798290 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:24.798245    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a179af8_e5e2_4a90_8ecd_6c55f89b865f.slice/crio-1698987c913d3ba6c728f20dc3b3d5a8628b0dc0f6355424c9562b9930194a3b WatchSource:0}: Error finding container 1698987c913d3ba6c728f20dc3b3d5a8628b0dc0f6355424c9562b9930194a3b: Status 404 returned error can't find the container with id 1698987c913d3ba6c728f20dc3b3d5a8628b0dc0f6355424c9562b9930194a3b
Sep 06 01:31:25.044924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.044822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" event={"ID":"5a179af8-e5e2-4a90-8ecd-6c55f89b865f","Type":"ContainerStarted","Data":"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"}
Sep 06 01:31:25.044924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.044884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" event={"ID":"5a179af8-e5e2-4a90-8ecd-6c55f89b865f","Type":"ContainerStarted","Data":"1698987c913d3ba6c728f20dc3b3d5a8628b0dc0f6355424c9562b9930194a3b"}
Sep 06 01:31:25.045156 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.044947    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:25.046448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.046421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" event={"ID":"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45","Type":"ContainerStarted","Data":"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"}
Sep 06 01:31:25.046583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.046469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" event={"ID":"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45","Type":"ContainerStarted","Data":"bb7f871d7beb6959007b9520bf508c7ab7bdea7ce521b53765136a8566a563da"}
Sep 06 01:31:25.046583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.046496    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:25.060921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.060863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" podStartSLOduration=1.060848258 podStartE2EDuration="1.060848258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:25.060484987 +0000 UTC m=+1315.062966553" watchObservedRunningTime="2026-09-06 01:31:25.060848258 +0000 UTC m=+1315.063329829"
Sep 06 01:31:25.077003 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:25.076963    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" podStartSLOduration=1.076950202 podStartE2EDuration="1.076950202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:25.075169597 +0000 UTC m=+1315.077651164" watchObservedRunningTime="2026-09-06 01:31:25.076950202 +0000 UTC m=+1315.079431768"
Sep 06 01:31:26.588405 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:26.588378    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:29.553834 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.553799    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"]
Sep 06 01:31:29.557358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.557338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:29.559677 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.559653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:31:29.559779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.559713    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:31:29.568327 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.568300    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"]
Sep 06 01:31:29.701007 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.700974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt\" (UID: \"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:29.802044 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.802015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt\" (UID: \"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:29.802630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.802611    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt\" (UID: \"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:29.874740 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:29.874719    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:30.146334 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:30.146313    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"]
Sep 06 01:31:30.148215 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:30.148156    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5a0eb2_d0b0_488b_afc0_0a355e7ff92d.slice/crio-c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962 WatchSource:0}: Error finding container c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962: Status 404 returned error can't find the container with id c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962
Sep 06 01:31:30.642060 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:30.642024    2582 scope.go:117] "RemoveContainer" containerID="8c048683f953e8c0e80dedd8302c4b3811e3d981a7f7cfd5577be1e089e0ea34"
Sep 06 01:31:31.081982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:31.081949    2582 generic.go:356] "Generic (PLEG): container finished" podID="2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" containerID="51c5c81d686034aabf0604efda62a2e6aa130ed9904832053591d30e9bcd7a86" exitCode=0
Sep 06 01:31:31.082148 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:31.082020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt" event={"ID":"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d","Type":"ContainerDied","Data":"51c5c81d686034aabf0604efda62a2e6aa130ed9904832053591d30e9bcd7a86"}
Sep 06 01:31:31.082148 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:31.082070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt" event={"ID":"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d","Type":"ContainerStarted","Data":"c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962"}
Sep 06 01:31:32.070492 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.070457    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" podUID="097efd1e-2ea3-4cea-b159-404163a51056" containerName="main" containerID="cri-o://a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea" gracePeriod=45
Sep 06 01:31:32.231732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.231706    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:32.323793 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.323716    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca\") pod \"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d\" (UID: \"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d\") "
Sep 06 01:31:32.324122 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.324086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" (UID: "2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:32.346592 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.346572    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:31:32.424598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424565    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9z5z\" (UniqueName: \"kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.424598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424601    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.424850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.424850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424657    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.424850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424702    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.424850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424735    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs\") pod \"097efd1e-2ea3-4cea-b159-404163a51056\" (UID: \"097efd1e-2ea3-4cea-b159-404163a51056\") "
Sep 06 01:31:32.425051 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424894    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache" (OuterVolumeSpecName: "model-cache") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:32.425051 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home" (OuterVolumeSpecName: "home") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:32.425051 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.424971    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:32.425161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.425058    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.425161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.425075    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.425161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.425091    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.425161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.425106    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.426922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.426901    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm" (OuterVolumeSpecName: "dshm") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:32.427002 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.426944    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z" (OuterVolumeSpecName: "kube-api-access-c9z5z") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "kube-api-access-c9z5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:32.427002 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.426952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "097efd1e-2ea3-4cea-b159-404163a51056" (UID: "097efd1e-2ea3-4cea-b159-404163a51056"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:31:32.526090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.526054    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/097efd1e-2ea3-4cea-b159-404163a51056-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.526090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.526083    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9z5z\" (UniqueName: \"kubernetes.io/projected/097efd1e-2ea3-4cea-b159-404163a51056-kube-api-access-c9z5z\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:32.526090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:32.526092    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/097efd1e-2ea3-4cea-b159-404163a51056-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:33.094147 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.094122    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"
Sep 06 01:31:33.094606 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.094160    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt" event={"ID":"2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d","Type":"ContainerDied","Data":"c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962"}
Sep 06 01:31:33.094606 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.094245    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5319d84b80b1603835921cbfb92838d065087711de2ef189b783dd9e25c0962"
Sep 06 01:31:33.095610 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.095587    2582 generic.go:356] "Generic (PLEG): container finished" podID="097efd1e-2ea3-4cea-b159-404163a51056" containerID="a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea" exitCode=0
Sep 06 01:31:33.095730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.095624    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"
Sep 06 01:31:33.095730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.095616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" event={"ID":"097efd1e-2ea3-4cea-b159-404163a51056","Type":"ContainerDied","Data":"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"}
Sep 06 01:31:33.095811 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.095732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk" event={"ID":"097efd1e-2ea3-4cea-b159-404163a51056","Type":"ContainerDied","Data":"52de78b8ad2b3814c99eee6552ea7c67be14fa1ece427beca0b0350267ba91ca"}
Sep 06 01:31:33.095811 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.095753    2582 scope.go:117] "RemoveContainer" containerID="a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"
Sep 06 01:31:33.105298 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.105267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:31:33.110665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.110648    2582 scope.go:117] "RemoveContainer" containerID="a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"
Sep 06 01:31:33.110993 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:31:33.110970    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea\": container with ID starting with a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea not found: ID does not exist" containerID="a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"
Sep 06 01:31:33.111044 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.111004    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea"} err="failed to get container status \"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea\": rpc error: code = NotFound desc = could not find container \"a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea\": container with ID starting with a0bfd39aa7809266476ad0317acecb8c1fd3dce19dac7689a6b750d3457809ea not found: ID does not exist"
Sep 06 01:31:33.118689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.118663    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:31:33.122992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:33.122970    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5833d5/rate-test-model-5833d5-kserve-6d45c554d7-xd8sk"]
Sep 06 01:31:34.477847 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:34.477811    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="097efd1e-2ea3-4cea-b159-404163a51056" path="/var/lib/kubelet/pods/097efd1e-2ea3-4cea-b159-404163a51056/volumes"
Sep 06 01:31:36.055655 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:36.055623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:31:36.056090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:36.055785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:31:39.849733 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:39.849697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:39.946795 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:39.946731    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:45.486844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.486802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:45.518730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.518683    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:31:45.519020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.518993    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" podUID="0181fb51-a294-4f63-90a3-0c62b4a223a3" containerName="payload-pre-processing" containerID="cri-o://387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc" gracePeriod=30
Sep 06 01:31:45.587162 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.587131    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:45.693249 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.692232    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:45.693249 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.692307    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"]
Sep 06 01:31:45.695648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.695625    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a7b006-dh4lt"]
Sep 06 01:31:45.751466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.751380    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:45.774312 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.774291    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:31:45.851025 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.850987    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume\") pod \"0181fb51-a294-4f63-90a3-0c62b4a223a3\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") "
Sep 06 01:31:45.851251 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.851054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbhs8\" (UniqueName: \"kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8\") pod \"0181fb51-a294-4f63-90a3-0c62b4a223a3\" (UID: \"0181fb51-a294-4f63-90a3-0c62b4a223a3\") "
Sep 06 01:31:45.851434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.851397    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0181fb51-a294-4f63-90a3-0c62b4a223a3" (UID: "0181fb51-a294-4f63-90a3-0c62b4a223a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:45.853695 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.853672    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8" (OuterVolumeSpecName: "kube-api-access-dbhs8") pod "0181fb51-a294-4f63-90a3-0c62b4a223a3" (UID: "0181fb51-a294-4f63-90a3-0c62b4a223a3"). InnerVolumeSpecName "kube-api-access-dbhs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:45.951973 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.951943    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0181fb51-a294-4f63-90a3-0c62b4a223a3-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:45.951973 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:45.951968    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbhs8\" (UniqueName: \"kubernetes.io/projected/0181fb51-a294-4f63-90a3-0c62b4a223a3-kube-api-access-dbhs8\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:46.063343 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.063271    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:46.172656 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.172623    2582 generic.go:356] "Generic (PLEG): container finished" podID="0181fb51-a294-4f63-90a3-0c62b4a223a3" containerID="387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc" exitCode=0
Sep 06 01:31:46.172828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.172676    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"
Sep 06 01:31:46.172828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.172699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" event={"ID":"0181fb51-a294-4f63-90a3-0c62b4a223a3","Type":"ContainerDied","Data":"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"}
Sep 06 01:31:46.172828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.172777    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt" event={"ID":"0181fb51-a294-4f63-90a3-0c62b4a223a3","Type":"ContainerDied","Data":"4704ea383846a41b73189e29b5075ac4fcb7071daffe74f9e44607dcae0f60a0"}
Sep 06 01:31:46.172828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.172810    2582 scope.go:117] "RemoveContainer" containerID="387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"
Sep 06 01:31:46.182020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.182004    2582 scope.go:117] "RemoveContainer" containerID="387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"
Sep 06 01:31:46.182342 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:31:46.182315    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc\": container with ID starting with 387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc not found: ID does not exist" containerID="387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"
Sep 06 01:31:46.182429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.182353    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc"} err="failed to get container status \"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc\": rpc error: code = NotFound desc = could not find container \"387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc\": container with ID starting with 387882cbee3d3fa5d2c06e765d11c7372c33609301f5a801893a5fe7abe66cbc not found: ID does not exist"
Sep 06 01:31:46.193394 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.193370    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:31:46.199115 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.199090    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a7b006-7d84754d46-js9bt"]
Sep 06 01:31:46.478085 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.478055    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0181fb51-a294-4f63-90a3-0c62b4a223a3" path="/var/lib/kubelet/pods/0181fb51-a294-4f63-90a3-0c62b4a223a3/volumes"
Sep 06 01:31:46.478409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:46.478396    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" path="/var/lib/kubelet/pods/2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d/volumes"
Sep 06 01:31:47.374558 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:47.374525    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:48.074415 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:48.074368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:48.382932 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:48.382901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:49.162348 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:49.162299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:49.793591 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:49.793559    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:31:51.778697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:51.778628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:51.881933 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:51.881886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:52.388762 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:52.388695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:52.492836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:52.492805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:52.666097 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:52.666000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:52.947708 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:52.947595    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:53.085797 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.085765    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"]
Sep 06 01:31:53.086229 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086209    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0181fb51-a294-4f63-90a3-0c62b4a223a3" containerName="payload-pre-processing"
Sep 06 01:31:53.086229 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086227    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0181fb51-a294-4f63-90a3-0c62b4a223a3" containerName="payload-pre-processing"
Sep 06 01:31:53.086229 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086234    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" containerName="revoke-keys"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086239    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" containerName="revoke-keys"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086252    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="097efd1e-2ea3-4cea-b159-404163a51056" containerName="main"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086259    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="097efd1e-2ea3-4cea-b159-404163a51056" containerName="main"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086316    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0181fb51-a294-4f63-90a3-0c62b4a223a3" containerName="payload-pre-processing"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086322    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d5a0eb2-d0b0-488b-afc0-0a355e7ff92d" containerName="revoke-keys"
Sep 06 01:31:53.086406 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.086328    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="097efd1e-2ea3-4cea-b159-404163a51056" containerName="main"
Sep 06 01:31:53.090713 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.090698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:53.093048 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.093029    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:31:53.093277 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.093064    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:31:53.097460 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.097436    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"]
Sep 06 01:31:53.112070 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.112045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-20a262-bzkw2\" (UID: \"8a7fd51f-ad47-4e85-a26f-70538f7e188a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:53.213523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.213438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-20a262-bzkw2\" (UID: \"8a7fd51f-ad47-4e85-a26f-70538f7e188a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:53.214044 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.214023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-20a262-bzkw2\" (UID: \"8a7fd51f-ad47-4e85-a26f-70538f7e188a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:53.317598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.317561    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:53.402274 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.402242    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:53.421112 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.421058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:53.515470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.515398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:53.516662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.516634    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:31:53.521381 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.521362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.525068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.525050    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0b81e1\""
Sep 06 01:31:53.525220 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.525201    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0b81e1-dockercfg-4z6fq\""
Sep 06 01:31:53.535684 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.535657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:31:53.552784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.552739    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:31:53.556507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.556486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.567472 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.567448    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:31:53.617262 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.617229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.617443 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.617315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjnxg\" (UniqueName: \"kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.617443 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.617355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p59h2\" (UniqueName: \"kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.617443 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.617394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.677531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.677509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"]
Sep 06 01:31:53.679595 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:53.679570    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a7fd51f_ad47_4e85_a26f_70538f7e188a.slice/crio-9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b WatchSource:0}: Error finding container 9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b: Status 404 returned error can't find the container with id 9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b
Sep 06 01:31:53.718058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.718167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjnxg\" (UniqueName: \"kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.718167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p59h2\" (UniqueName: \"kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.718167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.718694 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.718824 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.718804    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.726767 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.726741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjnxg\" (UniqueName: \"kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg\") pod \"payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:53.727046 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.727027    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p59h2\" (UniqueName: \"kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2\") pod \"payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.832740 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.832663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:53.870056 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:53.870027    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:54.111781 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.111760    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:31:54.113599 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:54.113568    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554d10b9_60c2_435a_b7c7_db6fcc6cae95.slice/crio-e50c85468478de27383dfbd49156b3d7eba907e6fdf1de3ceb3c048e0f2b8882 WatchSource:0}: Error finding container e50c85468478de27383dfbd49156b3d7eba907e6fdf1de3ceb3c048e0f2b8882: Status 404 returned error can't find the container with id e50c85468478de27383dfbd49156b3d7eba907e6fdf1de3ceb3c048e0f2b8882
Sep 06 01:31:54.156722 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.156638    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:31:54.158813 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:31:54.158791    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2edeef_c7a8_4098_8d1c_6f51bd4d1b9c.slice/crio-76d7e5f37328226bda7915ada00a0a8a61cd2caaeaf372c0b6514fa4957335b9 WatchSource:0}: Error finding container 76d7e5f37328226bda7915ada00a0a8a61cd2caaeaf372c0b6514fa4957335b9: Status 404 returned error can't find the container with id 76d7e5f37328226bda7915ada00a0a8a61cd2caaeaf372c0b6514fa4957335b9
Sep 06 01:31:54.227068 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.227040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" event={"ID":"554d10b9-60c2-435a-b7c7-db6fcc6cae95","Type":"ContainerStarted","Data":"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"}
Sep 06 01:31:54.227171 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.227119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" event={"ID":"554d10b9-60c2-435a-b7c7-db6fcc6cae95","Type":"ContainerStarted","Data":"e50c85468478de27383dfbd49156b3d7eba907e6fdf1de3ceb3c048e0f2b8882"}
Sep 06 01:31:54.227324 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.227170    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:31:54.229212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.229157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2" event={"ID":"8a7fd51f-ad47-4e85-a26f-70538f7e188a","Type":"ContainerStarted","Data":"2019537a54504be83cbb787e784a4ca21652fd4ea77d92888c7a520e1c94d891"}
Sep 06 01:31:54.229319 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.229234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2" event={"ID":"8a7fd51f-ad47-4e85-a26f-70538f7e188a","Type":"ContainerStarted","Data":"9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b"}
Sep 06 01:31:54.231341 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.231317    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" event={"ID":"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c","Type":"ContainerStarted","Data":"76d7e5f37328226bda7915ada00a0a8a61cd2caaeaf372c0b6514fa4957335b9"}
Sep 06 01:31:54.243223 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.243154    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" podStartSLOduration=1.2431355179999999 podStartE2EDuration="1.243135518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:54.241708746 +0000 UTC m=+1344.244190315" watchObservedRunningTime="2026-09-06 01:31:54.243135518 +0000 UTC m=+1344.245617085"
Sep 06 01:31:54.259468 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:54.259417    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2" podStartSLOduration=1.259400282 podStartE2EDuration="1.259400282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:54.258078944 +0000 UTC m=+1344.260560510" watchObservedRunningTime="2026-09-06 01:31:54.259400282 +0000 UTC m=+1344.261881849"
Sep 06 01:31:55.237830 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:55.237799    2582 generic.go:356] "Generic (PLEG): container finished" podID="8a7fd51f-ad47-4e85-a26f-70538f7e188a" containerID="2019537a54504be83cbb787e784a4ca21652fd4ea77d92888c7a520e1c94d891" exitCode=0
Sep 06 01:31:55.238276 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:55.237891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2" event={"ID":"8a7fd51f-ad47-4e85-a26f-70538f7e188a","Type":"ContainerDied","Data":"2019537a54504be83cbb787e784a4ca21652fd4ea77d92888c7a520e1c94d891"}
Sep 06 01:31:55.239490 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:55.239465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" event={"ID":"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c","Type":"ContainerStarted","Data":"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"}
Sep 06 01:31:55.239649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:55.239633    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:31:55.271502 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:55.271451    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" podStartSLOduration=2.271436655 podStartE2EDuration="2.271436655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:55.268667931 +0000 UTC m=+1345.271149498" watchObservedRunningTime="2026-09-06 01:31:55.271436655 +0000 UTC m=+1345.273918220"
Sep 06 01:31:56.381459 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:56.381432    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:56.445627 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:56.445596    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca\") pod \"8a7fd51f-ad47-4e85-a26f-70538f7e188a\" (UID: \"8a7fd51f-ad47-4e85-a26f-70538f7e188a\") "
Sep 06 01:31:56.445898 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:56.445878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a7fd51f-ad47-4e85-a26f-70538f7e188a" (UID: "8a7fd51f-ad47-4e85-a26f-70538f7e188a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:56.546747 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:56.546668    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a7fd51f-ad47-4e85-a26f-70538f7e188a-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:31:57.254241 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:57.254208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2" event={"ID":"8a7fd51f-ad47-4e85-a26f-70538f7e188a","Type":"ContainerDied","Data":"9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b"}
Sep 06 01:31:57.254397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:57.254257    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e853d2e996b4474058bf5b61fbc57a47927479a2e0fd02a649d1b91c6ff662b"
Sep 06 01:31:57.254397 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:57.254222    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"
Sep 06 01:31:58.107827 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:58.107797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:31:58.164283 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:31:58.164256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:05.094210 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:05.094130    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:32:05.241575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:05.241548    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:32:06.249974 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:06.249942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:32:08.853189 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:08.853144    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:08.878813 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:08.878782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:32:08.879335 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:08.879305    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" podUID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" containerName="payload-pre-processing" containerID="cri-o://c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e" gracePeriod=30
Sep 06 01:32:08.958279 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:08.958245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:09.024966 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.024928    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"]
Sep 06 01:32:09.025766 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.025738    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:09.027118 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.027096    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-20a262-bzkw2"]
Sep 06 01:32:09.081825 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.081794    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:09.129124 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.129103    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:32:09.265800 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.265760    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume\") pod \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") "
Sep 06 01:32:09.266010 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.265841    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg6ks\" (UniqueName: \"kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks\") pod \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\" (UID: \"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95\") "
Sep 06 01:32:09.266232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.266209    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" (UID: "a5c6ad82-6de9-457d-a693-8b1a8bcb5c95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:09.268020 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.268002    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks" (OuterVolumeSpecName: "kube-api-access-jg6ks") pod "a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" (UID: "a5c6ad82-6de9-457d-a693-8b1a8bcb5c95"). InnerVolumeSpecName "kube-api-access-jg6ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:09.317358 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.317320    2582 generic.go:356] "Generic (PLEG): container finished" podID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" containerID="c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e" exitCode=0
Sep 06 01:32:09.317524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.317364    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"
Sep 06 01:32:09.317524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.317400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" event={"ID":"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95","Type":"ContainerDied","Data":"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"}
Sep 06 01:32:09.317524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.317453    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47" event={"ID":"a5c6ad82-6de9-457d-a693-8b1a8bcb5c95","Type":"ContainerDied","Data":"30f5785e7922dc76394c0244e3d1c546f071e3d5423739272ccd54c94389c3c3"}
Sep 06 01:32:09.317524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.317476    2582 scope.go:117] "RemoveContainer" containerID="c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"
Sep 06 01:32:09.326995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.326979    2582 scope.go:117] "RemoveContainer" containerID="c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"
Sep 06 01:32:09.327295 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:32:09.327272    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e\": container with ID starting with c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e not found: ID does not exist" containerID="c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"
Sep 06 01:32:09.327665 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.327302    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e"} err="failed to get container status \"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e\": rpc error: code = NotFound desc = could not find container \"c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e\": container with ID starting with c2d95252dad1f6323defb1ebc13b431d8bb90fbaee2fdc1858554a762d89569e not found: ID does not exist"
Sep 06 01:32:09.337929 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.337910    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:32:09.342440 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.342422    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-20a262-77594b698-dnl47"]
Sep 06 01:32:09.366566 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.366518    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg6ks\" (UniqueName: \"kubernetes.io/projected/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-kube-api-access-jg6ks\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.366566 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.366538    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.399493 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:09.399469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:10.477628 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:10.477585    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7fd51f-ad47-4e85-a26f-70538f7e188a" path="/var/lib/kubelet/pods/8a7fd51f-ad47-4e85-a26f-70538f7e188a/volumes"
Sep 06 01:32:10.478132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:10.478078    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" path="/var/lib/kubelet/pods/a5c6ad82-6de9-457d-a693-8b1a8bcb5c95/volumes"
Sep 06 01:32:15.404202 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:15.404147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:15.519058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:15.519029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:15.714837 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:15.714763    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:16.201367 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:16.201330    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:32:16.688517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:16.688485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:21.860525 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:21.860491    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb_eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c/payload-processing/0.log"
Sep 06 01:32:26.437728 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.437689    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"]
Sep 06 01:32:26.440548 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.440505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:26.440773 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.440752    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-49c9de-29810970-lqk5n"]
Sep 06 01:32:26.479231 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.479169    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46e00fa-9cc0-469c-bef0-a5347b1acc51" path="/var/lib/kubelet/pods/f46e00fa-9cc0-469c-bef0-a5347b1acc51/volumes"
Sep 06 01:32:26.503581 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.503550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:26.603467 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.603426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:26.657507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.657482    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:26.991571 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:26.991524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:30.501433 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:30.501403    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:32:30.663637 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:30.663606    2582 scope.go:117] "RemoveContainer" containerID="b862900ed01e4c867d3841989f0bf15e65fe98881ab70147ac3980a13b0062ff"
Sep 06 01:32:32.667837 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:32.667804    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:32.725584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:32.725558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:32.999075 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:32.998995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:39.044214 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.044167    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:32:39.044836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.044815    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7fd51f-ad47-4e85-a26f-70538f7e188a" containerName="revoke-keys"
Sep 06 01:32:39.044931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.044839    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7fd51f-ad47-4e85-a26f-70538f7e188a" containerName="revoke-keys"
Sep 06 01:32:39.044931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.044861    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" containerName="payload-pre-processing"
Sep 06 01:32:39.044931 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.044869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" containerName="payload-pre-processing"
Sep 06 01:32:39.045086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.045008    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c6ad82-6de9-457d-a693-8b1a8bcb5c95" containerName="payload-pre-processing"
Sep 06 01:32:39.045086 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.045022    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7fd51f-ad47-4e85-a26f-70538f7e188a" containerName="revoke-keys"
Sep 06 01:32:39.049539 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.049518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.052479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.052363    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-de7322\"/\"openshift-service-ca.crt\""
Sep 06 01:32:39.053285 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.053255    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-de7322\"/\"kube-root-ca.crt\""
Sep 06 01:32:39.053426 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.053405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-de7322\"/\"ipp-route-de7322-kserve-self-signed-certs\""
Sep 06 01:32:39.054656 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.054513    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-de7322\"/\"default-dockercfg-bj9fb\""
Sep 06 01:32:39.061119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.061096    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:32:39.066844 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.066818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:39.145624 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.145789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.145789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145676    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.145789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145709    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.145789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjg9\" (UniqueName: \"kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.145789 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.145743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246707 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjg9\" (UniqueName: \"kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.246904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.246878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.247167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.247122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.247280 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.247253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.247347 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.247329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.249212 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.249168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.249515 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.249497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.254510 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.254492    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjg9\" (UniqueName: \"kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9\") pod \"ipp-route-de7322-kserve-646fbc5bff-k7dnr\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") " pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.363249 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.363138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:39.638525 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:39.638504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:32:39.640873 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:32:39.640845    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79302dc7_23f3_4608_a36e_28137fdea380.slice/crio-8553dcf69a7fc23a3f298c6664c3611382c652c4397fac45cf4a3c136bf25eef WatchSource:0}: Error finding container 8553dcf69a7fc23a3f298c6664c3611382c652c4397fac45cf4a3c136bf25eef: Status 404 returned error can't find the container with id 8553dcf69a7fc23a3f298c6664c3611382c652c4397fac45cf4a3c136bf25eef
Sep 06 01:32:40.485140 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:40.485106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" event={"ID":"79302dc7-23f3-4608-a36e-28137fdea380","Type":"ContainerStarted","Data":"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"}
Sep 06 01:32:40.485568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:40.485148    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" event={"ID":"79302dc7-23f3-4608-a36e-28137fdea380","Type":"ContainerStarted","Data":"8553dcf69a7fc23a3f298c6664c3611382c652c4397fac45cf4a3c136bf25eef"}
Sep 06 01:32:40.502753 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:40.502699    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" podStartSLOduration=1.502682503 podStartE2EDuration="1.502682503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:32:40.500906025 +0000 UTC m=+1390.503387592" watchObservedRunningTime="2026-09-06 01:32:40.502682503 +0000 UTC m=+1390.505164069"
Sep 06 01:32:43.394119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:43.394089    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:32:43.841505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:43.841429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:43.863458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:43.863426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:32:43.863729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:43.863684    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" podUID="30e58c6c-5ea5-4616-975a-498e2520ffa4" containerName="payload-processing" containerID="cri-o://c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070" gracePeriod=30
Sep 06 01:32:43.941923 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:43.941897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:44.030215 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.030157    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:44.084496 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.084468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:44.127007 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.126981    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:32:44.196995 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.196968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vchxr\" (UniqueName: \"kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr\") pod \"30e58c6c-5ea5-4616-975a-498e2520ffa4\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") "
Sep 06 01:32:44.197157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.197049    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume\") pod \"30e58c6c-5ea5-4616-975a-498e2520ffa4\" (UID: \"30e58c6c-5ea5-4616-975a-498e2520ffa4\") "
Sep 06 01:32:44.197436 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.197417    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30e58c6c-5ea5-4616-975a-498e2520ffa4" (UID: "30e58c6c-5ea5-4616-975a-498e2520ffa4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:44.199145 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.199125    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr" (OuterVolumeSpecName: "kube-api-access-vchxr") pod "30e58c6c-5ea5-4616-975a-498e2520ffa4" (UID: "30e58c6c-5ea5-4616-975a-498e2520ffa4"). InnerVolumeSpecName "kube-api-access-vchxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:44.298090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.298056    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30e58c6c-5ea5-4616-975a-498e2520ffa4-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.298090 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.298085    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vchxr\" (UniqueName: \"kubernetes.io/projected/30e58c6c-5ea5-4616-975a-498e2520ffa4-kube-api-access-vchxr\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.395389 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.395344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:44.507821 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.507788    2582 generic.go:356] "Generic (PLEG): container finished" podID="30e58c6c-5ea5-4616-975a-498e2520ffa4" containerID="c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070" exitCode=0
Sep 06 01:32:44.507950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.507839    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"
Sep 06 01:32:44.507950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.507876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" event={"ID":"30e58c6c-5ea5-4616-975a-498e2520ffa4","Type":"ContainerDied","Data":"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"}
Sep 06 01:32:44.507950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.507925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6" event={"ID":"30e58c6c-5ea5-4616-975a-498e2520ffa4","Type":"ContainerDied","Data":"0117c558cb5ac5595cc2576b454f5d2d331dc7d78d15fa49ac52960b9d05f089"}
Sep 06 01:32:44.507950 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.507947    2582 scope.go:117] "RemoveContainer" containerID="c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"
Sep 06 01:32:44.517236 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.517217    2582 scope.go:117] "RemoveContainer" containerID="c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"
Sep 06 01:32:44.517509 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:32:44.517493    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070\": container with ID starting with c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070 not found: ID does not exist" containerID="c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"
Sep 06 01:32:44.517554 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.517517    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070"} err="failed to get container status \"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070\": rpc error: code = NotFound desc = could not find container \"c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070\": container with ID starting with c28589a18333e31461e0d04b66c031b5cc99fa0cb3a4dc77d7c1f1e11d517070 not found: ID does not exist"
Sep 06 01:32:44.525448 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.525426    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:32:44.533032 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:44.529995    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-bff89d-6556d8d7d9-h7bk6"]
Sep 06 01:32:46.477811 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:46.477775    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30e58c6c-5ea5-4616-975a-498e2520ffa4" path="/var/lib/kubelet/pods/30e58c6c-5ea5-4616-975a-498e2520ffa4/volumes"
Sep 06 01:32:49.363417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:49.363377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:49.363417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:49.363426    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:49.376507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:49.376481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:49.546427 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:49.546391    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:32:50.118395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:50.118369    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:50.181058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:50.181031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:50.381365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:50.381337    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:32:53.502720 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:32:53.502683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:33:16.808507 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:16.808477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:33:23.170690 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:23.170612    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf_5a179af8-e5e2-4a90-8ecd-6c55f89b865f/payload-processing/0.log"
Sep 06 01:33:23.424472 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:23.424396    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb_eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c/payload-processing/0.log"
Sep 06 01:33:23.698683 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:23.698571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:24.019504 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:24.019429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:24.254855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:24.254823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:27.450784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:27.450754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:27.545849 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:27.545817    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:28.739427 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:28.739395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:28.819781 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:28.819755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:29.174352 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:29.174322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:29.274773 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:29.274746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:36.397732 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:36.397697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:33:36.829664 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:36.829583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:53.272922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:53.272873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:59.283430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:59.283398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:59.383837 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:59.383806    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:59.458430 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:59.458403    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:59.515304 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:59.515272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:33:59.848372 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:33:59.848343    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:03.197545 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:03.197513    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:34:05.440575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:05.440539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:05.541234 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:05.541171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:05.701833 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:05.701742    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:22.203868 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:22.203829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:34:25.022063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.022037    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:25.050882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.050852    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:34:25.051486 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.051287    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" podUID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" containerName="payload-processing" containerID="cri-o://11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c" gracePeriod=30
Sep 06 01:34:25.057045 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.057019    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:34:25.057381 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.057356    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" podUID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" containerName="payload-pre-processing" containerID="cri-o://7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b" gracePeriod=30
Sep 06 01:34:25.096922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.096890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:25.159560 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.159533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:25.229479 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.229345    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:25.332736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.332716    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:34:25.335583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.335566    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:34:25.445466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume\") pod \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") "
Sep 06 01:34:25.445466 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445469    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5bz9\" (UniqueName: \"kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9\") pod \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") "
Sep 06 01:34:25.445657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume\") pod \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\" (UID: \"5a179af8-e5e2-4a90-8ecd-6c55f89b865f\") "
Sep 06 01:34:25.445657 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-269r2\" (UniqueName: \"kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2\") pod \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\" (UID: \"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45\") "
Sep 06 01:34:25.445880 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445858    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" (UID: "c64e2752-1dec-4d2a-a71c-0a4a13cd7b45"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:34:25.445964 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445937    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a179af8-e5e2-4a90-8ecd-6c55f89b865f" (UID: "5a179af8-e5e2-4a90-8ecd-6c55f89b865f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:34:25.445964 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.445955    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.447767 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.447742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9" (OuterVolumeSpecName: "kube-api-access-r5bz9") pod "5a179af8-e5e2-4a90-8ecd-6c55f89b865f" (UID: "5a179af8-e5e2-4a90-8ecd-6c55f89b865f"). InnerVolumeSpecName "kube-api-access-r5bz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:25.447845 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.447783    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2" (OuterVolumeSpecName: "kube-api-access-269r2") pod "c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" (UID: "c64e2752-1dec-4d2a-a71c-0a4a13cd7b45"). InnerVolumeSpecName "kube-api-access-269r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:25.546586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.546555    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.546586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.546580    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-269r2\" (UniqueName: \"kubernetes.io/projected/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45-kube-api-access-269r2\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.546586 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.546589    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5bz9\" (UniqueName: \"kubernetes.io/projected/5a179af8-e5e2-4a90-8ecd-6c55f89b865f-kube-api-access-r5bz9\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.586481 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:25.586407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:26.050597 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.050560    2582 generic.go:356] "Generic (PLEG): container finished" podID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" containerID="11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c" exitCode=0
Sep 06 01:34:26.050597 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.050600    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"
Sep 06 01:34:26.051127 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.050648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" event={"ID":"5a179af8-e5e2-4a90-8ecd-6c55f89b865f","Type":"ContainerDied","Data":"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"}
Sep 06 01:34:26.051127 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.050699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf" event={"ID":"5a179af8-e5e2-4a90-8ecd-6c55f89b865f","Type":"ContainerDied","Data":"1698987c913d3ba6c728f20dc3b3d5a8628b0dc0f6355424c9562b9930194a3b"}
Sep 06 01:34:26.051127 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.050721    2582 scope.go:117] "RemoveContainer" containerID="11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"
Sep 06 01:34:26.052070 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.052050    2582 generic.go:356] "Generic (PLEG): container finished" podID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" containerID="7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b" exitCode=0
Sep 06 01:34:26.052157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.052096    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"
Sep 06 01:34:26.052157 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.052138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" event={"ID":"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45","Type":"ContainerDied","Data":"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"}
Sep 06 01:34:26.052346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.052201    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr" event={"ID":"c64e2752-1dec-4d2a-a71c-0a4a13cd7b45","Type":"ContainerDied","Data":"bb7f871d7beb6959007b9520bf508c7ab7bdea7ce521b53765136a8566a563da"}
Sep 06 01:34:26.060652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.060425    2582 scope.go:117] "RemoveContainer" containerID="11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"
Sep 06 01:34:26.060800 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:34:26.060780    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c\": container with ID starting with 11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c not found: ID does not exist" containerID="11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"
Sep 06 01:34:26.060882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.060807    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c"} err="failed to get container status \"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c\": rpc error: code = NotFound desc = could not find container \"11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c\": container with ID starting with 11c40e4b9100916604d71827897d61f1942de8beb2c3377565a0b4f65154c37c not found: ID does not exist"
Sep 06 01:34:26.060882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.060823    2582 scope.go:117] "RemoveContainer" containerID="7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"
Sep 06 01:34:26.070584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.070563    2582 scope.go:117] "RemoveContainer" containerID="7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"
Sep 06 01:34:26.070830 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:34:26.070812    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b\": container with ID starting with 7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b not found: ID does not exist" containerID="7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"
Sep 06 01:34:26.070910 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.070833    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b"} err="failed to get container status \"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b\": rpc error: code = NotFound desc = could not find container \"7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b\": container with ID starting with 7efba0e81cb43efebff7dc23366e307b6cb88cea2056ccafd9092937abc10f6b not found: ID does not exist"
Sep 06 01:34:26.075532 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.075512    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:34:26.077456 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.077437    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-de7322-66f7f9fcff-d4zkf"]
Sep 06 01:34:26.086520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.086501    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:34:26.090164 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.090145    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-de7322-557dbd5d78-95bxr"]
Sep 06 01:34:26.477662 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.477628    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" path="/var/lib/kubelet/pods/5a179af8-e5e2-4a90-8ecd-6c55f89b865f/volumes"
Sep 06 01:34:26.478006 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:26.477992    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" path="/var/lib/kubelet/pods/c64e2752-1dec-4d2a-a71c-0a4a13cd7b45/volumes"
Sep 06 01:34:30.531165 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:30.531141    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:34:30.535792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:30.535768    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:34:30.589075 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:30.589049    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:34:30.685513 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:30.685467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:34:34.706982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:34.706946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:34:45.608721 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.608676    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" podUID="79302dc7-23f3-4608-a36e-28137fdea380" containerName="main" containerID="cri-o://f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf" gracePeriod=45
Sep 06 01:34:45.865999 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.865940    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:34:45.937166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937364 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937364 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937364 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdjg9\" (UniqueName: \"kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937364 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937359    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937383    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm\") pod \"79302dc7-23f3-4608-a36e-28137fdea380\" (UID: \"79302dc7-23f3-4608-a36e-28137fdea380\") "
Sep 06 01:34:45.937584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937515    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:45.937584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache" (OuterVolumeSpecName: "model-cache") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:45.937754 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937630    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home" (OuterVolumeSpecName: "home") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:45.937971 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937889    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:45.937971 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937909    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:45.937971 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.937922    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:45.939555 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.939534    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:34:45.939908 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.939884    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm" (OuterVolumeSpecName: "dshm") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:45.940047 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:45.940019    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9" (OuterVolumeSpecName: "kube-api-access-zdjg9") pod "79302dc7-23f3-4608-a36e-28137fdea380" (UID: "79302dc7-23f3-4608-a36e-28137fdea380"). InnerVolumeSpecName "kube-api-access-zdjg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:46.038680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.038651    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdjg9\" (UniqueName: \"kubernetes.io/projected/79302dc7-23f3-4608-a36e-28137fdea380-kube-api-access-zdjg9\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:46.038680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.038675    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79302dc7-23f3-4608-a36e-28137fdea380-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:46.038680 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.038686    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79302dc7-23f3-4608-a36e-28137fdea380-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:34:46.156840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.156811    2582 generic.go:356] "Generic (PLEG): container finished" podID="79302dc7-23f3-4608-a36e-28137fdea380" containerID="f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf" exitCode=0
Sep 06 01:34:46.157027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.156855    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"
Sep 06 01:34:46.157027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.156886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" event={"ID":"79302dc7-23f3-4608-a36e-28137fdea380","Type":"ContainerDied","Data":"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"}
Sep 06 01:34:46.157027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.156917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr" event={"ID":"79302dc7-23f3-4608-a36e-28137fdea380","Type":"ContainerDied","Data":"8553dcf69a7fc23a3f298c6664c3611382c652c4397fac45cf4a3c136bf25eef"}
Sep 06 01:34:46.157027 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.156932    2582 scope.go:117] "RemoveContainer" containerID="f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"
Sep 06 01:34:46.166434 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.166413    2582 scope.go:117] "RemoveContainer" containerID="f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"
Sep 06 01:34:46.166700 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:34:46.166684    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf\": container with ID starting with f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf not found: ID does not exist" containerID="f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"
Sep 06 01:34:46.166746 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.166707    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf"} err="failed to get container status \"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf\": rpc error: code = NotFound desc = could not find container \"f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf\": container with ID starting with f4bf9483c7be71f83da202e046777a77465710e7e1bc373315bf509721bbd9bf not found: ID does not exist"
Sep 06 01:34:46.180470 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.180435    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:34:46.185417 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.185391    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-de7322/ipp-route-de7322-kserve-646fbc5bff-k7dnr"]
Sep 06 01:34:46.478014 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:34:46.477932    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79302dc7-23f3-4608-a36e-28137fdea380" path="/var/lib/kubelet/pods/79302dc7-23f3-4608-a36e-28137fdea380/volumes"
Sep 06 01:35:07.055575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:07.055545    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:07.705524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:07.705493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:13.243987 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:13.243880    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:13.299168 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:13.299138    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:13.509729 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:13.509652    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:22.900365 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:22.900327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:24.252499 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.252467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:24.276531 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.276498    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:35:24.276822 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.276795    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" podUID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" containerName="payload-processing" containerID="cri-o://e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1" gracePeriod=30
Sep 06 01:35:24.281534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.281506    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:35:24.281894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.281867    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" podUID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" containerName="payload-pre-processing" containerID="cri-o://9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0" gracePeriod=30
Sep 06 01:35:24.551648 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.551626    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:35:24.554882 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.554860    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:35:24.594593 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.594569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume\") pod \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") "
Sep 06 01:35:24.594725 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.594602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjnxg\" (UniqueName: \"kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg\") pod \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\" (UID: \"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c\") "
Sep 06 01:35:24.594927 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.594906    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" (UID: "eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:24.596921 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.596892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg" (OuterVolumeSpecName: "kube-api-access-xjnxg") pod "eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" (UID: "eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c"). InnerVolumeSpecName "kube-api-access-xjnxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:24.696092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.696061    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p59h2\" (UniqueName: \"kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2\") pod \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") "
Sep 06 01:35:24.696278 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.696199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume\") pod \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\" (UID: \"554d10b9-60c2-435a-b7c7-db6fcc6cae95\") "
Sep 06 01:35:24.696369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.696357    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:24.696428 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.696371    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjnxg\" (UniqueName: \"kubernetes.io/projected/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c-kube-api-access-xjnxg\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:24.696568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.696539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "554d10b9-60c2-435a-b7c7-db6fcc6cae95" (UID: "554d10b9-60c2-435a-b7c7-db6fcc6cae95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:24.698189 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.698159    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2" (OuterVolumeSpecName: "kube-api-access-p59h2") pod "554d10b9-60c2-435a-b7c7-db6fcc6cae95" (UID: "554d10b9-60c2-435a-b7c7-db6fcc6cae95"). InnerVolumeSpecName "kube-api-access-p59h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:24.797396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.797329    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/554d10b9-60c2-435a-b7c7-db6fcc6cae95-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:24.797396 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:24.797353    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p59h2\" (UniqueName: \"kubernetes.io/projected/554d10b9-60c2-435a-b7c7-db6fcc6cae95-kube-api-access-p59h2\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:25.250838 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.250799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:25.362584 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.362552    2582 generic.go:356] "Generic (PLEG): container finished" podID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" containerID="e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1" exitCode=0
Sep 06 01:35:25.362988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.362593    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"
Sep 06 01:35:25.362988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.362643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" event={"ID":"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c","Type":"ContainerDied","Data":"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"}
Sep 06 01:35:25.362988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.362691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb" event={"ID":"eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c","Type":"ContainerDied","Data":"76d7e5f37328226bda7915ada00a0a8a61cd2caaeaf372c0b6514fa4957335b9"}
Sep 06 01:35:25.362988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.362722    2582 scope.go:117] "RemoveContainer" containerID="e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"
Sep 06 01:35:25.364040 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.364024    2582 generic.go:356] "Generic (PLEG): container finished" podID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" containerID="9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0" exitCode=0
Sep 06 01:35:25.364105 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.364072    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"
Sep 06 01:35:25.364105 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.364081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" event={"ID":"554d10b9-60c2-435a-b7c7-db6fcc6cae95","Type":"ContainerDied","Data":"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"}
Sep 06 01:35:25.364199 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.364107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb" event={"ID":"554d10b9-60c2-435a-b7c7-db6fcc6cae95","Type":"ContainerDied","Data":"e50c85468478de27383dfbd49156b3d7eba907e6fdf1de3ceb3c048e0f2b8882"}
Sep 06 01:35:25.372146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.372127    2582 scope.go:117] "RemoveContainer" containerID="e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"
Sep 06 01:35:25.372512 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:35:25.372488    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1\": container with ID starting with e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1 not found: ID does not exist" containerID="e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"
Sep 06 01:35:25.372607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.372526    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1"} err="failed to get container status \"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1\": rpc error: code = NotFound desc = could not find container \"e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1\": container with ID starting with e3abf43e392ac3ea13bd96e4235e12feead96095e4956280c46c01c7adeb4de1 not found: ID does not exist"
Sep 06 01:35:25.372607 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.372547    2582 scope.go:117] "RemoveContainer" containerID="9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"
Sep 06 01:35:25.380839 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.380823    2582 scope.go:117] "RemoveContainer" containerID="9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"
Sep 06 01:35:25.381107 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:35:25.381090    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0\": container with ID starting with 9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0 not found: ID does not exist" containerID="9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"
Sep 06 01:35:25.381166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.381112    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0"} err="failed to get container status \"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0\": rpc error: code = NotFound desc = could not find container \"9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0\": container with ID starting with 9dc88aa03a52b2e9965954a8309b231e98e392acd8b704f24d3610ec7151c9c0 not found: ID does not exist"
Sep 06 01:35:25.388011 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.387990    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:35:25.393800 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.393780    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0b81e1-86945f544b-qh6hb"]
Sep 06 01:35:25.403246 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.403227    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:35:25.405419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:25.405400    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0b81e1-56f7bfb4df-wz8jb"]
Sep 06 01:35:26.478562 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:26.478531    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" path="/var/lib/kubelet/pods/554d10b9-60c2-435a-b7c7-db6fcc6cae95/volumes"
Sep 06 01:35:26.478941 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:26.478879    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" path="/var/lib/kubelet/pods/eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c/volumes"
Sep 06 01:35:27.192810 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:27.192776    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:35:30.587588 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:30.587551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:30.688139 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:30.688111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:30.860488 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:30.860401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:31.213623 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.213590    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"]
Sep 06 01:35:31.214041 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214023    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79302dc7-23f3-4608-a36e-28137fdea380" containerName="main"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214044    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="79302dc7-23f3-4608-a36e-28137fdea380" containerName="main"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214064    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" containerName="payload-processing"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214073    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" containerName="payload-processing"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214098    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" containerName="payload-pre-processing"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214107    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" containerName="payload-pre-processing"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214119    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" containerName="payload-processing"
Sep 06 01:35:31.214134 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214127    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214146    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30e58c6c-5ea5-4616-975a-498e2520ffa4" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214155    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="30e58c6c-5ea5-4616-975a-498e2520ffa4" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214168    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" containerName="payload-pre-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214194    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" containerName="payload-pre-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214290    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb2edeef-c7a8-4098-8d1c-6f51bd4d1b9c" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214303    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a179af8-e5e2-4a90-8ecd-6c55f89b865f" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214312    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="554d10b9-60c2-435a-b7c7-db6fcc6cae95" containerName="payload-pre-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214322    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64e2752-1dec-4d2a-a71c-0a4a13cd7b45" containerName="payload-pre-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214334    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="30e58c6c-5ea5-4616-975a-498e2520ffa4" containerName="payload-processing"
Sep 06 01:35:31.214527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.214344    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="79302dc7-23f3-4608-a36e-28137fdea380" containerName="main"
Sep 06 01:35:31.218383 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.218364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:31.220855 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.220822    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:35:31.221032 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.220993    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:35:31.224818 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.224795    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"]
Sep 06 01:35:31.361000 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.360957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w\" (UID: \"b58074ac-549b-4c01-b96f-37356670fbcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:31.461862 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.461835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w\" (UID: \"b58074ac-549b-4c01-b96f-37356670fbcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:31.462458 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.462439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w\" (UID: \"b58074ac-549b-4c01-b96f-37356670fbcd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:31.530784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.530725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:31.801669 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:31.801642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"]
Sep 06 01:35:31.803609 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:35:31.803582    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58074ac_549b_4c01_b96f_37356670fbcd.slice/crio-b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05 WatchSource:0}: Error finding container b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05: Status 404 returned error can't find the container with id b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05
Sep 06 01:35:32.404689 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:32.404655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w" event={"ID":"b58074ac-549b-4c01-b96f-37356670fbcd","Type":"ContainerStarted","Data":"9b8bee9a3b4beeb95829241a51c434f8b664c528ef5f923e8bb616898f85a22b"}
Sep 06 01:35:32.404894 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:32.404732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w" event={"ID":"b58074ac-549b-4c01-b96f-37356670fbcd","Type":"ContainerStarted","Data":"b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05"}
Sep 06 01:35:32.420598 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:32.420544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w" podStartSLOduration=1.4205302340000001 podStartE2EDuration="1.420530234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:35:32.419786747 +0000 UTC m=+1562.422268316" watchObservedRunningTime="2026-09-06 01:35:32.420530234 +0000 UTC m=+1562.423011811"
Sep 06 01:35:33.411832 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:33.411792    2582 generic.go:356] "Generic (PLEG): container finished" podID="b58074ac-549b-4c01-b96f-37356670fbcd" containerID="9b8bee9a3b4beeb95829241a51c434f8b664c528ef5f923e8bb616898f85a22b" exitCode=0
Sep 06 01:35:33.412240 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:33.411874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w" event={"ID":"b58074ac-549b-4c01-b96f-37356670fbcd","Type":"ContainerDied","Data":"9b8bee9a3b4beeb95829241a51c434f8b664c528ef5f923e8bb616898f85a22b"}
Sep 06 01:35:34.549012 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:34.548982    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:34.691451 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:34.691378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca\") pod \"b58074ac-549b-4c01-b96f-37356670fbcd\" (UID: \"b58074ac-549b-4c01-b96f-37356670fbcd\") "
Sep 06 01:35:34.691706 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:34.691685    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b58074ac-549b-4c01-b96f-37356670fbcd" (UID: "b58074ac-549b-4c01-b96f-37356670fbcd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:34.792267 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:34.792230    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b58074ac-549b-4c01-b96f-37356670fbcd-maas-api-service-ca\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:35.423914 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:35.423886    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"
Sep 06 01:35:35.424095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:35.423881    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w" event={"ID":"b58074ac-549b-4c01-b96f-37356670fbcd","Type":"ContainerDied","Data":"b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05"}
Sep 06 01:35:35.424095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:35.424022    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a7795aa2ee48ef247d3ede43410b7397230968d13117f4adbc2ddb4189dc05"
Sep 06 01:35:41.619827 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.619797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:41.681527 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.681500    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:41.781516 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.781483    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"]
Sep 06 01:35:41.782256 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.782220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:41.784784 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.784758    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5833d5-4gt8w"]
Sep 06 01:35:41.860074 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:41.860048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:42.189356 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:42.189323    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:42.477418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:42.477344    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b58074ac-549b-4c01-b96f-37356670fbcd" path="/var/lib/kubelet/pods/b58074ac-549b-4c01-b96f-37356670fbcd/volumes"
Sep 06 01:35:44.291511 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:44.291473    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:35:48.173286 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:48.173252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:48.273736 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:48.273706    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:48.457867 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:48.457785    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.207786 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.207755    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"]
Sep 06 01:35:59.210615 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.210588    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-41f259-29810970-t5xdx"]
Sep 06 01:35:59.212191 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.212146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.227620 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.227593    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:35:59.227883 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.227858    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" podUID="151639f8-acff-4a88-a0f7-5cb4894ee09c" containerName="payload-processing" containerID="cri-o://fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7" gracePeriod=30
Sep 06 01:35:59.239285 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.239262    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:35:59.239645 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.239617    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" podUID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" containerName="payload-pre-processing" containerID="cri-o://2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec" gracePeriod=30
Sep 06 01:35:59.273854 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.273825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.376947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.376910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.442487 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.442458    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.503055 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.503035    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:35:59.505992 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.505976    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:35:59.551981 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.551952    2582 generic.go:356] "Generic (PLEG): container finished" podID="151639f8-acff-4a88-a0f7-5cb4894ee09c" containerID="fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7" exitCode=0
Sep 06 01:35:59.552131 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.551989    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"
Sep 06 01:35:59.552131 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.552041    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" event={"ID":"151639f8-acff-4a88-a0f7-5cb4894ee09c","Type":"ContainerDied","Data":"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"}
Sep 06 01:35:59.552131 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.552100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh" event={"ID":"151639f8-acff-4a88-a0f7-5cb4894ee09c","Type":"ContainerDied","Data":"2829c163212ca5a83e1e1ba2d77499639ab14cdb924f21a619e7402aa8052d5d"}
Sep 06 01:35:59.552300 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.552132    2582 scope.go:117] "RemoveContainer" containerID="fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"
Sep 06 01:35:59.553409 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.553387    2582 generic.go:356] "Generic (PLEG): container finished" podID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" containerID="2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec" exitCode=0
Sep 06 01:35:59.553476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.553429    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"
Sep 06 01:35:59.553534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.553470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" event={"ID":"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1","Type":"ContainerDied","Data":"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"}
Sep 06 01:35:59.553534 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.553523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr" event={"ID":"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1","Type":"ContainerDied","Data":"8c991d1afacb12c13807cfa83c217eba5fe43416773d8482d9344fbc0415225e"}
Sep 06 01:35:59.562583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.562562    2582 scope.go:117] "RemoveContainer" containerID="fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"
Sep 06 01:35:59.562856 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:35:59.562836    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7\": container with ID starting with fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7 not found: ID does not exist" containerID="fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"
Sep 06 01:35:59.562922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.562869    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7"} err="failed to get container status \"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7\": rpc error: code = NotFound desc = could not find container \"fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7\": container with ID starting with fc5ac99a6517b24561ab588c3805b45e542bb3d29e9027b622ac58e1ae4fd3b7 not found: ID does not exist"
Sep 06 01:35:59.562922 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.562886    2582 scope.go:117] "RemoveContainer" containerID="2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"
Sep 06 01:35:59.570525 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.570509    2582 scope.go:117] "RemoveContainer" containerID="2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"
Sep 06 01:35:59.570793 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:35:59.570774    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec\": container with ID starting with 2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec not found: ID does not exist" containerID="2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"
Sep 06 01:35:59.570888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.570796    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec"} err="failed to get container status \"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec\": rpc error: code = NotFound desc = could not find container \"2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec\": container with ID starting with 2ab1d7ff15f5565b19a07dcca0c8283290263e15dd57f7d15b2ac56e593fc4ec not found: ID does not exist"
Sep 06 01:35:59.613246 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdqfp\" (UniqueName: \"kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp\") pod \"151639f8-acff-4a88-a0f7-5cb4894ee09c\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") "
Sep 06 01:35:59.613346 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613311    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume\") pod \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") "
Sep 06 01:35:59.613385 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume\") pod \"151639f8-acff-4a88-a0f7-5cb4894ee09c\" (UID: \"151639f8-acff-4a88-a0f7-5cb4894ee09c\") "
Sep 06 01:35:59.613420 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613393    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvh5n\" (UniqueName: \"kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n\") pod \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\" (UID: \"93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1\") "
Sep 06 01:35:59.613715 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613693    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" (UID: "93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:59.613963 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.613755    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "151639f8-acff-4a88-a0f7-5cb4894ee09c" (UID: "151639f8-acff-4a88-a0f7-5cb4894ee09c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:59.615313 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.615289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp" (OuterVolumeSpecName: "kube-api-access-kdqfp") pod "151639f8-acff-4a88-a0f7-5cb4894ee09c" (UID: "151639f8-acff-4a88-a0f7-5cb4894ee09c"). InnerVolumeSpecName "kube-api-access-kdqfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:59.615500 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.615482    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n" (OuterVolumeSpecName: "kube-api-access-dvh5n") pod "93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" (UID: "93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1"). InnerVolumeSpecName "kube-api-access-dvh5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:59.714152 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.714127    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdqfp\" (UniqueName: \"kubernetes.io/projected/151639f8-acff-4a88-a0f7-5cb4894ee09c-kube-api-access-kdqfp\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.714152 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.714149    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.714307 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.714159    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/151639f8-acff-4a88-a0f7-5cb4894ee09c-plugins-config-volume\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.714307 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.714168    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvh5n\" (UniqueName: \"kubernetes.io/projected/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1-kube-api-access-dvh5n\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.755505 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.755447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:35:59.877167 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.877140    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:35:59.880528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.880508    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-41f259-75b4ccd794-l2ztr"]
Sep 06 01:35:59.890403 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.890381    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:35:59.896379 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:35:59.896357    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-41f259-7958b56455-tl7qh"]
Sep 06 01:36:00.477405 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:00.477375    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="151639f8-acff-4a88-a0f7-5cb4894ee09c" path="/var/lib/kubelet/pods/151639f8-acff-4a88-a0f7-5cb4894ee09c/volumes"
Sep 06 01:36:00.477773 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:00.477668    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93704d62-913e-42b7-a3fd-03302150a100" path="/var/lib/kubelet/pods/93704d62-913e-42b7-a3fd-03302150a100/volumes"
Sep 06 01:36:00.477985 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:00.477969    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" path="/var/lib/kubelet/pods/93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1/volumes"
Sep 06 01:36:01.604106 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:01.604075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:36:05.559552 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:05.559523    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:36:05.625836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:05.625809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:36:05.828583 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:05.828493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:36:10.501452 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:10.501424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:36:30.748339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:30.748269    2582 scope.go:117] "RemoveContainer" containerID="286b8db6644dc7fd174d168fc43a45010ab83e7ec22a1f192eb5788e24e4ab77"
Sep 06 01:36:30.756285 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:36:30.756265    2582 scope.go:117] "RemoveContainer" containerID="c7c3d4f1dfb94100e6bed92eef5db309c4b5f170028d25505defd719ee714d3f"
Sep 06 01:37:30.785208 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:37:30.785147    2582 scope.go:117] "RemoveContainer" containerID="51c5c81d686034aabf0604efda62a2e6aa130ed9904832053591d30e9bcd7a86"
Sep 06 01:37:30.993232 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:37:30.993201    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:37:31.996927 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:37:31.996898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:37:33.526104 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:37:33.526070    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:37:55.406628 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:37:55.406555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:38:02.994319 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:02.994286    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:38:09.897038 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:09.897005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:38:13.432075 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:13.432046    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:38:17.401475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:17.401439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:38:19.383625 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:19.383597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:38:30.803911 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:30.803881    2582 scope.go:117] "RemoveContainer" containerID="2019537a54504be83cbb787e784a4ca21652fd4ea77d92888c7a520e1c94d891"
Sep 06 01:38:31.502936 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:31.502899    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:38:38.107369 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:38:38.107331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:39:30.559644 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:39:30.559617    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:39:30.567419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:39:30.567399    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:39:30.670568 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:39:30.670539    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:39:30.720735 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:39:30.720711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:40:04.505095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:04.505059    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:40:11.801816 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:11.801780    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:40:17.836982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.836939    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837421    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="151639f8-acff-4a88-a0f7-5cb4894ee09c" containerName="payload-processing"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837435    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="151639f8-acff-4a88-a0f7-5cb4894ee09c" containerName="payload-processing"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837443    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" containerName="payload-pre-processing"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837448    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" containerName="payload-pre-processing"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837460    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b58074ac-549b-4c01-b96f-37356670fbcd" containerName="revoke-keys"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837466    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b58074ac-549b-4c01-b96f-37356670fbcd" containerName="revoke-keys"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837543    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b58074ac-549b-4c01-b96f-37356670fbcd" containerName="revoke-keys"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837551    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="151639f8-acff-4a88-a0f7-5cb4894ee09c" containerName="payload-processing"
Sep 06 01:40:17.839476 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.837561    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a13f83-f6a2-4e36-8d6b-c8cbf05c82e1" containerName="payload-pre-processing"
Sep 06 01:40:17.840492 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.840476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.843095 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.843076    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-d12672e8-kserve-self-signed-certs\""
Sep 06 01:40:17.853616 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.853596    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:40:17.870606 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.870584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:40:17.996295 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.996454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.996454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.996454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.996454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqcvf\" (UniqueName: \"kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:17.996630 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:17.996480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097799 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.097948 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.097924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqcvf\" (UniqueName: \"kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.098336 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.098301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.098463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.098350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.098463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.098380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.100302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.100284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.100580 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.100547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.106982 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.106962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqcvf\" (UniqueName: \"kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf\") pod \"e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") " pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.151021 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.151002    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:18.425016 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.424976    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:40:18.426454 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:40:18.426430    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7289cd3e_c053_45a5_a5af_187a02fa5cc8.slice/crio-81976250bf3bf36b749442c81e67c608dd82592e125a7cc860c75e16724beaca WatchSource:0}: Error finding container 81976250bf3bf36b749442c81e67c608dd82592e125a7cc860c75e16724beaca: Status 404 returned error can't find the container with id 81976250bf3bf36b749442c81e67c608dd82592e125a7cc860c75e16724beaca
Sep 06 01:40:18.810087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.810006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" event={"ID":"7289cd3e-c053-45a5-a5af-187a02fa5cc8","Type":"ContainerStarted","Data":"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"}
Sep 06 01:40:18.810087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.810045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" event={"ID":"7289cd3e-c053-45a5-a5af-187a02fa5cc8","Type":"ContainerStarted","Data":"81976250bf3bf36b749442c81e67c608dd82592e125a7cc860c75e16724beaca"}
Sep 06 01:40:18.827386 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:18.827339    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" podStartSLOduration=1.827323409 podStartE2EDuration="1.827323409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:40:18.825555709 +0000 UTC m=+1848.828037276" watchObservedRunningTime="2026-09-06 01:40:18.827323409 +0000 UTC m=+1848.829804974"
Sep 06 01:40:20.703741 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:20.703712    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:40:24.330946 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.330915    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:40:24.335159 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.335129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.337792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.337768    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d12672e8-kserve-self-signed-certs\""
Sep 06 01:40:24.346024 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.345999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:40:24.357636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.357774 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357749    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.357850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.357850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.357958 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95q88\" (UniqueName: \"kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.357958 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.357898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.384402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.384375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:40:24.458616 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.458616 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.458843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.458843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95q88\" (UniqueName: \"kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.458843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.458843 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.458789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.459339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.459305    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.459463 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.459403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.459697 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.459677    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.467419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.467396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.468495 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.468474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.468788 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.468768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95q88\" (UniqueName: \"kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88\") pod \"e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") " pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.646517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.646484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:24.918979 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:24.918955    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:40:24.920820 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:40:24.920789    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1858a47_b11a_44e0_99ea_89c7fdefe7ea.slice/crio-0056b3bd2f927475429f98440ef04d6c5c2469148ddf72615750049ac2795324 WatchSource:0}: Error finding container 0056b3bd2f927475429f98440ef04d6c5c2469148ddf72615750049ac2795324: Status 404 returned error can't find the container with id 0056b3bd2f927475429f98440ef04d6c5c2469148ddf72615750049ac2795324
Sep 06 01:40:25.845803 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:25.845769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" event={"ID":"c1858a47-b11a-44e0-99ea-89c7fdefe7ea","Type":"ContainerStarted","Data":"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"}
Sep 06 01:40:25.846196 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:25.845810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" event={"ID":"c1858a47-b11a-44e0-99ea-89c7fdefe7ea","Type":"ContainerStarted","Data":"0056b3bd2f927475429f98440ef04d6c5c2469148ddf72615750049ac2795324"}
Sep 06 01:40:25.864421 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:25.864352    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" podStartSLOduration=1.864332522 podStartE2EDuration="1.864332522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:40:25.864064353 +0000 UTC m=+1855.866545920" watchObservedRunningTime="2026-09-06 01:40:25.864332522 +0000 UTC m=+1855.866814091"
Sep 06 01:40:28.001804 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:28.001771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:40:28.151981 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:28.151947    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:28.152155 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:28.151995    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:28.164514 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:28.164490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:28.870554 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:28.870523    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:40:34.647063 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:34.647030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:34.647567 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:34.647088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:34.659730 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:34.659710    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:34.899636 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:34.899556    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:40:50.650449 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:50.650414    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:40:50.674517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:50.674488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:40:51.548174 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:51.548098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:40:51.751850 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:51.751818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:40:53.596980 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:40:53.596945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:41:00.503054 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:00.503023    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:41:05.602123 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:05.602088    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:41:05.671485 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:05.671445    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" podUID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" containerName="main" containerID="cri-o://25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76" gracePeriod=45
Sep 06 01:41:05.923469 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:05.921098    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:41:06.036133 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036099    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036166    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036262    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036326 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036294    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036344    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqcvf\" (UniqueName: \"kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home\") pod \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\" (UID: \"7289cd3e-c053-45a5-a5af-187a02fa5cc8\") "
Sep 06 01:41:06.036523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036495    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache" (OuterVolumeSpecName: "model-cache") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.036523 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036505    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.036746 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home" (OuterVolumeSpecName: "home") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.036805 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036739    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.036805 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.036760    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.037652 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.037624    2582 generic.go:356] "Generic (PLEG): container finished" podID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" containerID="25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76" exitCode=0
Sep 06 01:41:06.037777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.037666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" event={"ID":"7289cd3e-c053-45a5-a5af-187a02fa5cc8","Type":"ContainerDied","Data":"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"}
Sep 06 01:41:06.037777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.037677    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"
Sep 06 01:41:06.037777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.037706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9" event={"ID":"7289cd3e-c053-45a5-a5af-187a02fa5cc8","Type":"ContainerDied","Data":"81976250bf3bf36b749442c81e67c608dd82592e125a7cc860c75e16724beaca"}
Sep 06 01:41:06.037777 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.037727    2582 scope.go:117] "RemoveContainer" containerID="25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"
Sep 06 01:41:06.038859 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.038830    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm" (OuterVolumeSpecName: "dshm") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.038988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.038849    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf" (OuterVolumeSpecName: "kube-api-access-jqcvf") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "kube-api-access-jqcvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:41:06.038988 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.038887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7289cd3e-c053-45a5-a5af-187a02fa5cc8" (UID: "7289cd3e-c053-45a5-a5af-187a02fa5cc8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:41:06.058161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.058142    2582 scope.go:117] "RemoveContainer" containerID="25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"
Sep 06 01:41:06.058507 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:41:06.058491    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76\": container with ID starting with 25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76 not found: ID does not exist" containerID="25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"
Sep 06 01:41:06.058565 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.058515    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76"} err="failed to get container status \"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76\": rpc error: code = NotFound desc = could not find container \"25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76\": container with ID starting with 25a283c1d964afbdf1be2f47abfcb60572510aad45e1f2ac7849f62b58ed0d76 not found: ID does not exist"
Sep 06 01:41:06.137828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.137799    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqcvf\" (UniqueName: \"kubernetes.io/projected/7289cd3e-c053-45a5-a5af-187a02fa5cc8-kube-api-access-jqcvf\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.137828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.137823    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.137828 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.137833    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7289cd3e-c053-45a5-a5af-187a02fa5cc8-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.138017 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.137841    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7289cd3e-c053-45a5-a5af-187a02fa5cc8-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.358280 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.358248    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:41:06.361649 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.361627    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-d12672e8-kserve-7df797d579-4mlg9"]
Sep 06 01:41:06.477299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.477271    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" path="/var/lib/kubelet/pods/7289cd3e-c053-45a5-a5af-187a02fa5cc8/volumes"
Sep 06 01:41:06.568938 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.568903    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" podUID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" containerName="main" containerID="cri-o://b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff" gracePeriod=45
Sep 06 01:41:06.821888 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.821864    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:41:06.845057 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845032    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845210 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845066    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845210 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845109    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845210 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845161    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845242    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95q88\" (UniqueName: \"kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845271    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs\") pod \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\" (UID: \"c1858a47-b11a-44e0-99ea-89c7fdefe7ea\") "
Sep 06 01:41:06.845402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.845402 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845384    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home" (OuterVolumeSpecName: "home") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.845593 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.845679 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845662    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tmp-dir\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.845737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845682    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-home\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.845737 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.845691    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-model-cache\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.847414 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.847385    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm" (OuterVolumeSpecName: "dshm") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:41:06.847528 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.847474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:41:06.847575 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.847555    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88" (OuterVolumeSpecName: "kube-api-access-95q88") pod "c1858a47-b11a-44e0-99ea-89c7fdefe7ea" (UID: "c1858a47-b11a-44e0-99ea-89c7fdefe7ea"). InnerVolumeSpecName "kube-api-access-95q88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:41:06.946132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.946058    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-dshm\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.946132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.946085    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95q88\" (UniqueName: \"kubernetes.io/projected/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-kube-api-access-95q88\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:06.946132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:06.946096    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1858a47-b11a-44e0-99ea-89c7fdefe7ea-tls-certs\") on node \"ip-10-0-132-205.ec2.internal\" DevicePath \"\""
Sep 06 01:41:07.043310 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.043280    2582 generic.go:356] "Generic (PLEG): container finished" podID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" containerID="b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff" exitCode=0
Sep 06 01:41:07.043475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.043329    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"
Sep 06 01:41:07.043475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.043367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" event={"ID":"c1858a47-b11a-44e0-99ea-89c7fdefe7ea","Type":"ContainerDied","Data":"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"}
Sep 06 01:41:07.043475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.043424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5" event={"ID":"c1858a47-b11a-44e0-99ea-89c7fdefe7ea","Type":"ContainerDied","Data":"0056b3bd2f927475429f98440ef04d6c5c2469148ddf72615750049ac2795324"}
Sep 06 01:41:07.043475 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.043453    2582 scope.go:117] "RemoveContainer" containerID="b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"
Sep 06 01:41:07.052807 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.052787    2582 scope.go:117] "RemoveContainer" containerID="b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"
Sep 06 01:41:07.053085 ip-10-0-132-205 kubenswrapper[2582]: E0906 01:41:07.053068    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff\": container with ID starting with b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff not found: ID does not exist" containerID="b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"
Sep 06 01:41:07.053132 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.053095    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff"} err="failed to get container status \"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff\": rpc error: code = NotFound desc = could not find container \"b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff\": container with ID starting with b6f51d839be729aaf3152a7166eeae160225988c7983817835f8133a9db4f5ff not found: ID does not exist"
Sep 06 01:41:07.063611 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.063590    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:41:07.065478 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:07.065454    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d12672e8-kserve-c8d74c955-m74m5"]
Sep 06 01:41:08.477339 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:08.477309    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" path="/var/lib/kubelet/pods/c1858a47-b11a-44e0-99ea-89c7fdefe7ea/volumes"
Sep 06 01:41:38.246601 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:38.246563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:41:38.295136 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:41:38.295104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:42:30.849924 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:42:30.849852    2582 scope.go:117] "RemoveContainer" containerID="9b8bee9a3b4beeb95829241a51c434f8b664c528ef5f923e8bb616898f85a22b"
Sep 06 01:44:13.401286 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:13.401200    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:44:19.800872 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:19.800839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:44:25.794889 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:25.794853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:44:30.591291 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:30.591262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:44:30.599511 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:30.599490    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-js5jq_f9b7fd35-4f46-4f4e-b217-84a964bad302/ovn-acl-logging/0.log"
Sep 06 01:44:32.697959 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:32.697928    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-s82s4"]
Sep 06 01:44:41.514521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:41.514469    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lvmtj_d659c78d-f83a-4289-8154-13a21cd00a3c/manager/0.log"
Sep 06 01:44:42.123301 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:42.123273    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-tmb6t_3b6d0697-080b-45af-95a4-4f5edf002c18/copy-manifests/0.log"
Sep 06 01:44:42.129792 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:42.129774    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-tmb6t_3b6d0697-080b-45af-95a4-4f5edf002c18/manager/0.log"
Sep 06 01:44:42.717400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:42.717377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29810970-b86vl_c22ce8f1-ccc4-4b6e-841a-e8fc75cec2f3/cleanup/0.log"
Sep 06 01:44:44.222418 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:44.222392    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-s82s4_f69d056b-3577-46b9-a7e6-ccb78ff8aaa4/limitador/0.log"
Sep 06 01:44:45.048214 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:45.048162    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-tp8df_27ef8b49-166a-4847-9d53-a0864eb7a264/kube-auth-proxy/0.log"
Sep 06 01:44:45.984747 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:45.984716    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-675h7_57c8cec7-043d-4c4e-943f-ded09c74354a/main/0.log"
Sep 06 01:44:46.101330 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:46.101298    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-qx787_bead89ee-317b-48d7-89fd-024989f01941/main/0.log"
Sep 06 01:44:46.332461 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:46.332377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwtvss_bdc6a577-51f4-411b-ba5a-ed333ee82d13/main/0.log"
Sep 06 01:44:46.561835 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:46.561810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-7sp56_7403f46e-0dfd-447f-9668-caa777fa4bc9/main/0.log"
Sep 06 01:44:52.386521 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:52.386487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:44:52.504701 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:52.504669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:44:55.417201 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:55.417155    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n97kl_c731e94b-ea94-46f5-975a-7a356865f7db/global-pull-secret-syncer/0.log"
Sep 06 01:44:55.545786 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:55.545758    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log"
Sep 06 01:44:55.697654 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:44:55.697574    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-205.ec2.internal_eaef65e55aa5f7053cfe7a3a8e382309/haproxy/0.log"
Sep 06 01:45:00.535671 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:00.535587    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-s82s4_f69d056b-3577-46b9-a7e6-ccb78ff8aaa4/limitador/0.log"
Sep 06 01:45:02.580004 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.579931    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xqnbs_6fbe95b5-12d9-4712-9254-b27e6fda1be6/kube-state-metrics/0.log"
Sep 06 01:45:02.608491 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.608449    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xqnbs_6fbe95b5-12d9-4712-9254-b27e6fda1be6/kube-rbac-proxy-main/0.log"
Sep 06 01:45:02.646166 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.646144    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-xqnbs_6fbe95b5-12d9-4712-9254-b27e6fda1be6/kube-rbac-proxy-self/0.log"
Sep 06 01:45:02.673262 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.673242    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-587bf8b95c-k2zfj_8960d23b-38cd-4a4a-8f25-d1f6ec89802a/metrics-server/0.log"
Sep 06 01:45:02.699031 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.699008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-jxpqm_15b2b662-c261-42fb-8aa0-d39efa0bf1c1/monitoring-plugin/0.log"
Sep 06 01:45:02.736423 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.736403    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6p9j_6577b814-9e03-4121-8b06-6b050e4e138e/node-exporter/0.log"
Sep 06 01:45:02.760016 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.759995    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6p9j_6577b814-9e03-4121-8b06-6b050e4e138e/kube-rbac-proxy/0.log"
Sep 06 01:45:02.784602 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:02.784581    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f6p9j_6577b814-9e03-4121-8b06-6b050e4e138e/init-textfile/0.log"
Sep 06 01:45:03.001059 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.001033    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-2l8x9_0541adff-c7af-4e9b-811f-4e3367908c79/kube-rbac-proxy-main/0.log"
Sep 06 01:45:03.023625 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.023599    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-2l8x9_0541adff-c7af-4e9b-811f-4e3367908c79/kube-rbac-proxy-self/0.log"
Sep 06 01:45:03.048509 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.048486    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-2l8x9_0541adff-c7af-4e9b-811f-4e3367908c79/openshift-state-metrics/0.log"
Sep 06 01:45:03.093947 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.093922    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/prometheus/0.log"
Sep 06 01:45:03.171429 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.171403    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/config-reloader/0.log"
Sep 06 01:45:03.214428 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.214395    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/thanos-sidecar/0.log"
Sep 06 01:45:03.242293 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.242268    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/kube-rbac-proxy-web/0.log"
Sep 06 01:45:03.270058 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.269998    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/kube-rbac-proxy/0.log"
Sep 06 01:45:03.298161 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.298137    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/kube-rbac-proxy-thanos/0.log"
Sep 06 01:45:03.328026 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.328002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74672651-9951-4c61-bdb9-482b3e5ee1fa/init-config-reloader/0.log"
Sep 06 01:45:03.374119 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.374092    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fsx4r_f7e1ebb6-0ac8-446b-b010-c8dcbb017903/prometheus-operator/0.log"
Sep 06 01:45:03.401169 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.401151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-fsx4r_f7e1ebb6-0ac8-446b-b010-c8dcbb017903/kube-rbac-proxy/0.log"
Sep 06 01:45:03.439492 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.439469    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-cnqm4_04c4daa8-850e-4907-bd0b-6514152a92c4/prometheus-operator-admission-webhook/0.log"
Sep 06 01:45:03.590071 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.589999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/thanos-query/0.log"
Sep 06 01:45:03.614864 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.614843    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/kube-rbac-proxy-web/0.log"
Sep 06 01:45:03.653840 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.653819    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/kube-rbac-proxy/0.log"
Sep 06 01:45:03.684823 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.684794    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/prom-label-proxy/0.log"
Sep 06 01:45:03.719395 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.719361    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/kube-rbac-proxy-rules/0.log"
Sep 06 01:45:03.755937 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:03.755898    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5655fbb567-rdq4h_50f3e34f-fbe9-4d54-a9ad-fecc46bfd9b7/kube-rbac-proxy-metrics/0.log"
Sep 06 01:45:05.084756 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.084722    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"]
Sep 06 01:45:05.085146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085074    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" containerName="main"
Sep 06 01:45:05.085146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085085    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" containerName="main"
Sep 06 01:45:05.085146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085111    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" containerName="main"
Sep 06 01:45:05.085146 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085116    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" containerName="main"
Sep 06 01:45:05.085312 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085201    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1858a47-b11a-44e0-99ea-89c7fdefe7ea" containerName="main"
Sep 06 01:45:05.085312 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.085211    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7289cd3e-c053-45a5-a5af-187a02fa5cc8" containerName="main"
Sep 06 01:45:05.088299 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.088276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.091427 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.091408    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"kube-root-ca.crt\""
Sep 06 01:45:05.092400 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.092371    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44kv5\"/\"default-dockercfg-kn5hd\""
Sep 06 01:45:05.093454 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.093436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"openshift-service-ca.crt\""
Sep 06 01:45:05.098158 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.098136    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"]
Sep 06 01:45:05.129565 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.129540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-lib-modules\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.129685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.129581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-sys\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.129685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.129630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-proc\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.129685 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.129668    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-podres\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.129808 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.129733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbx78\" (UniqueName: \"kubernetes.io/projected/49f860a3-ca13-452d-9d3f-78d4530da4d1-kube-api-access-rbx78\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231087 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-podres\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbx78\" (UniqueName: \"kubernetes.io/projected/49f860a3-ca13-452d-9d3f-78d4530da4d1-kube-api-access-rbx78\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-lib-modules\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231241    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-podres\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-sys\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231302 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231282    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-proc\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-lib-modules\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231349    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-sys\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.231520 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.231364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/49f860a3-ca13-452d-9d3f-78d4530da4d1-proc\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.242577 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.242556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbx78\" (UniqueName: \"kubernetes.io/projected/49f860a3-ca13-452d-9d3f-78d4530da4d1-kube-api-access-rbx78\") pod \"perf-node-gather-daemonset-k8sjk\" (UID: \"49f860a3-ca13-452d-9d3f-78d4530da4d1\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.398914 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.398886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:05.670043 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:05.670014    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"]
Sep 06 01:45:05.671992 ip-10-0-132-205 kubenswrapper[2582]: W0906 01:45:05.671968    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod49f860a3_ca13_452d_9d3f_78d4530da4d1.slice/crio-992da38a578f445cf976fff941b1ace4f45485ea220ff65e6f4e227017e5bb45 WatchSource:0}: Error finding container 992da38a578f445cf976fff941b1ace4f45485ea220ff65e6f4e227017e5bb45: Status 404 returned error can't find the container with id 992da38a578f445cf976fff941b1ace4f45485ea220ff65e6f4e227017e5bb45
Sep 06 01:45:06.177368 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:06.177338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk" event={"ID":"49f860a3-ca13-452d-9d3f-78d4530da4d1","Type":"ContainerStarted","Data":"8bedc9942eabae35e63b396c94dc0bd97b7edd46609ea1801cff55b274db5f7d"}
Sep 06 01:45:06.177836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:06.177395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk" event={"ID":"49f860a3-ca13-452d-9d3f-78d4530da4d1","Type":"ContainerStarted","Data":"992da38a578f445cf976fff941b1ace4f45485ea220ff65e6f4e227017e5bb45"}
Sep 06 01:45:06.177836 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:06.177473    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:06.198818 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:06.198772    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk" podStartSLOduration=1.198758362 podStartE2EDuration="1.198758362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:45:06.197608231 +0000 UTC m=+2136.200089798" watchObservedRunningTime="2026-09-06 01:45:06.198758362 +0000 UTC m=+2136.201239928"
Sep 06 01:45:06.214524 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:06.214502    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bd7cdb44f-qh2nv_5bc010c4-621d-465a-866e-917f767298be/console/0.log"
Sep 06 01:45:08.068506 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:08.068481    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzfxt_ffa66ac2-e7d7-418c-a600-87d2edd354cc/dns/0.log"
Sep 06 01:45:08.109374 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:08.109350    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kzfxt_ffa66ac2-e7d7-418c-a600-87d2edd354cc/kube-rbac-proxy/0.log"
Sep 06 01:45:08.338557 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:08.338486    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b878j_ec82469a-1c83-488e-a8e9-6b52fda99171/dns-node-resolver/0.log"
Sep 06 01:45:09.047904 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:09.047872    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4l89g_c295b51f-eedb-40f8-b427-4d940dffc043/node-ca/0.log"
Sep 06 01:45:10.765457 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:10.765425    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-tp8df_27ef8b49-166a-4847-9d53-a0864eb7a264/kube-auth-proxy/0.log"
Sep 06 01:45:12.193013 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:12.192985    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-k8sjk"
Sep 06 01:45:12.301770 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:12.301734    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zk8jl_c56f943e-4335-4d1a-a1b0-a55f26170fad/serve-healthcheck-canary/0.log"
Sep 06 01:45:12.463741 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:12.463659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:45:12.984190 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:12.984149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kvmk_35317b55-e8a3-46fb-a822-d460b35fb8a3/kube-rbac-proxy/0.log"
Sep 06 01:45:13.018031 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:13.018006    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kvmk_35317b55-e8a3-46fb-a822-d460b35fb8a3/exporter/0.log"
Sep 06 01:45:13.053916 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:13.053891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9kvmk_35317b55-e8a3-46fb-a822-d460b35fb8a3/extractor/0.log"
Sep 06 01:45:15.888092 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:15.888055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-lvmtj_d659c78d-f83a-4289-8154-13a21cd00a3c/manager/0.log"
Sep 06 01:45:15.903419 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:15.903396    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-tp8df_27ef8b49-166a-4847-9d53-a0864eb7a264/kube-auth-proxy/0.log"
Sep 06 01:45:16.208517 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:16.208435    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-tmb6t_3b6d0697-080b-45af-95a4-4f5edf002c18/manager/0.log"
Sep 06 01:45:16.252361 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:16.252334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-tmb6t_3b6d0697-080b-45af-95a4-4f5edf002c18/copy-manifests/0.log"
Sep 06 01:45:16.403364 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:16.403332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:45:16.514779 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:16.514695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4w6lh_3abc434c-0079-4166-b374-2e2093fc4b8f/konnectivity-agent/0.log" limit=1024
Sep 06 01:45:17.726983 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:17.726959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68cb9d866d-b4k82_2e5568c9-37c7-4cf6-aeaa-d8031e9484ba/manager/0.log"
Sep 06 01:45:17.819596 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:17.819565    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xstj6_23a68635-7758-436e-b282-67bd26f32eb2/openshift-lws-operator/0.log"
Sep 06 01:45:17.911236 ip-10-0-132-205 kubenswrapper[2582]: I0906 01:45:17.911210    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-tp8df_27ef8b49-166a-4847-9d53-a0864eb7a264/kube-auth-proxy/0.log"